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ABSTRACT 

This report provides information about the program 
evaluation study of a national biodiversity education program for 
youth in the United States known as ’’Windows on the World” launched 
by the World Wildlife Fund. The curriculum development project is 
organized into four phases: (1) a biodiversity needs assessment; (2) 

the development of biodiversity education materials and formative 
evaluation; (3) training and implementation; and (4) dissemination 
and summative evaluation of the project. The goal of the program is 
to educate youth about what biodiversity is, what it means to 
humanity, the causes behind the loss of biodiversity, and ways to 
address the problem. This report includes an overview of biodiversity 
education and the need for assessment of biodiversity literacy, a 
description of the development of the biodiversity education 
framework, details of the development of the biodiversity assessment 
instrument for middle school students, development and results of the 
formative assessment instrument for select activities, and a 
discussion of the use of the framework. The appendices contain a 
listing of the advisory board and program evaluation steering 
committee members, framework validation, details about the pilot 
studies, the formative evaluation instrument, and formative 
evaluation item and subscale results. Contains 141 references. 
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Development of a Biodiversity Literacy Assessment Instrument 



I. Introduction 

Scientific organizations around the world have raised concern about the continuous decline of 
the world's biodiversity. In the United States, the National Academy of Sciences and the 
Science Advisory Board to the U.S. Environmental Protection Agency have suggested that it is 
one of the most critical environmental problems facing the world. 

Although some of our best scientific minds are in general agreement that loss of biodiversity is 
a global concern, there seems to be limited awareness of the problem among the general public. 
In 1992, a national opinion survey conducted by Peter Hart Research Associates found only one 
percent of those surveyed listed endangered species as a serious environmental problem. When 
given the opportunity, no respondents listed loss of biodiversity as a problem and only one in 
five said they had never heard of ‘loss of biological diversity’. When presented with the 
concerns expressed by scientists, most respondents expressed their new found concern and 
suggested that educational programs should be initiated to make the public more aware of the 
problem. 

Overview of Biodiversity Education 

World Wildlife Fund (WWF) is one scientific organization that has dedicated its efforts to 
protect biodiversity. It has concerned itself with the lack of public awareness by initiating a 
variety of biodiversity education programs around the world. In 1993, with funding from 
Eastman Kodak Company, World Wildlife Fund elected to launch a national biodiversity 
education program for youth in the United States. The goal of the program is to educate youth 
about what biodiversity is, what it means to humanity, the causes behind the loss of biodiversity 
and ways to address the problem. The title of the program became Windows on the Wild. 

To help plan and guide the Windows on the Wild effort, WWF assembled an advisory board of 
relevant educational leaders from around the country (Appendix A). The advisory board 
ultimately decided that the Windows on the Wild program would initially be directed at students 
in middle school (i.e., 6-9th grades). It was felt that this age level had the ability to both 
un derstand the problem and to take or initiate personal actions or behaviors related to the 
problem. The advisory board also agreed on four phases for the Windows on the Wild effort 
which are listed below. 

Phase I Biodiversity Education Need Assessment. Answering the questions: What is 

being taught? What should be taught? Who should teach it? What resources do 
educators need? 

Phase II Development of biodiversity education materials and formative evaluation. 

Phase III Training and implementation 

Phase IV Dissemination and summative evaluation of the Windows on the Wild program. 
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Funding provided by the National Environmental Education and Training Foundation (NEETF) 
contributed to the completion of Phase I and to significant progress on Phase II. In particular, 
NEETF funds were used for Phase I to determine what should be taught to middle school youth 
(i.e., development of biodiversity literacy framework). In addition, for Phase II, NEETF funds 
were used to develop an assessment instrument that might serve to determine what students 
know, feel, and do about protecting biodiversity. It was hoped that this instrument would also 
be sensitive enough to determine if change in biodiversity literacy occurs as a result of 
involvement in the Windows on the Wild program or some other relevant biodiversity 
instruction. 

Need for Assessment of Biodiversity Literacy 

The need to invest resources into the development of a biodiversity education framework and 
middle school assessment instrument was justified by an extensive literature search which 
suggested no such documents existed for use in general, or more specifically, for use in 
evaluating the effectiveness of the Windows on the Wild curriculum. 

WWF established a partnership with the Wisconsin Center for Environmental Education 
(WCEE) at the University of Wisconsin-Stevens Point to develop the framework and 
assessment instrument. Staff at the WCEE have extensive experience in developing 
educational frameworks and assessment instruments at both the state and national levels. 
Additionally, WWF secured a Program Evaluation Steering Committee (PESC) of nationally 
known educational researchers to oversee the project (Appendix B). 

A research assistant (i.e., AnneMarie VanDam) was hired to serve as primary day-to-day staff 
for the project. Ms. VanDam was working on her MS degree in environmental education and 
her thesis was based on the development of the assessment instrument. 

II. Development of the Biodiversity Education Framework 

As a first step to developing the Windows on the Wild curriculum, it was important to develop a 
conceptual outline or framework of what biodiversity concepts should be covered in a 
comprehensive curriculum. This framework would also serve as a guideline for the 
development of relevant assessment instruments. 

Validation of the Biodiversity Education Framework 

An extensive literature review was conducted to identify concepts that professionals around the 
world felt were important to a basic citizen understanding of biodiversity. Project staff then 
used this information to develop a draft biodiversity education framework. This draft was sent 
out for a preliminary review to relevant members of the PESC. Preliminary revisions were 
made and the framework was then sent out for a more formal review and validation. Copies 
were sent to members of the National Advisory Committee and the PESC (Appendices A and 
B). The forms used in this review/validation process are found in Appendix C. 

Using feedback from this formal validation process, a biodiversity education framework was 
ultimately revised and developed. The resulting framework (see following page) then served 
as the content basis for both the development of the Windows on the Wild curriculum and the 
biodiversity assessment instrument for middle school students. 

O 2 

ERIC 



7 



World Wildlife Fund - Windows on the Wild 
Biodiversity Education Framework 



I. Key Concepts 

Definition 

♦ Biological diversity, or "biodiversity," encompasses the variety of all life on Earth from 
microscopic plants to blue whales. It also includes the variety of ecosystems and 
ecological processes that sustain this life. 

♦ Biodiversity is commonly analyzed at these three levels: 

1 . Ecosystem diversity refers to the variety of habitats, biological communities, and 
ecosystems where organisms live and evolve. It also refers to the variety of 
ecological processes within ecosystems. 

2. Species diversity describes the numbers and variety of habitats, biological 
communities, and ecosystems where organisms live and evolve. It also refers to 
the variety of ecological processes within ecosystems. 

3. Genetic diversity refers to the sum total of genetic information contained in the 
genes of organisms. This can be examined at the level of individuals, populations, 
or species. 

Factors Affecting Biodiversity 

♦ Natural systems are dynamic and disturbances help maintain ecosystem health. Small 
scale disturbances, such as a tree falling in a forest, can actually maintain or increase 
biodiversity. 

♦ Biodiversity is the key to the resilience of nature after intense changes in environmental 
conditions such as floods, earthquakes, hurricanes, and volcanic eruptions. 

♦ Human-induced changes in the environment, such as pollution, habitat degradation, and 
the introduction of exotic species, push the limits of nature's resilience and may lead to 
irreversible environmental damage and biodiversity loss on human time scales. 

♦ Biodiversity is reduced by changes in the environment that exceed the ability of 
populations of plants, animals, and other living things to adapt. This inability to adapt to 
changing environmental conditions leads to the extinction of species - either locally or 
globally. 

♦ The loss and degradation of entire ecosystems, such as forests, wetlands, and coastal 
waters, is the single most important factor behind the current extinction of species. This 
large-scale degradation is the result of human population growth, pollution, and 
nonsustainable consumption patterns. 

The Value of Biodiversity 

♦ Biodiversity helps support life on Earth in many ways. For example, genetic diversity 
wi thin species allows species to adapt to changes in the environment over time; species 
diversity provides a variety of interactions that contribute to energy flow and nutrient 
cycling in ecosystems; and ecosystem diversity provides a suite of ecological "services" 
that maintain the biosphere, including water and air purification, micro-climate control, 
and soil stability. 
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♦ Human welfare depends on biological diversity for economic benefits such as sustaining 
and improving agriculture and providing opportunities for medical discoveries and 
industrial innovations. 

♦ Although not as apparent, the long-term value of biodiversity is just as significant as the 
value today. 

♦ People value biodiversity for aesthetic, moral, spiritual, educational, economic, 
recreational, and other reasons. 

♦ Culture is closely linked to biodiversity. Our cultures are shaped, in part, by the 
environment. And our collective knowledge of biodiversity, including its use and 
management, is linked to the many ways different cultures interact with the environment. 
Efforts to conserve biodiversity must be developed within the constructs of local cultures. 
Conversely, conserving biodiversity often helps strengthen cultural integrity and values. 

♦ There are many interrelated political, economic, and social issues that develop as a result 
of human impact on biodiversity. 

I II. Biodiversity Issues ] 

♦ The human impact on biodiversity is more significant today than ever before. 

♦ Environmental problems associated with biodiversity loss don't always adversely affect 
all people in a region equally - they often disproportionately affect only certain 
populations, such as low-income communities. 

♦ Biodiversity issues are associated with conflicts in values and beliefs. 

♦ Individuals play an important role in resolving biodiversity problems and issues. 

♦ Scientific and technological means exist to manage and protect biodiversity , however, 
science and technology may not always be adequate to resolve biodiversity problems and 
issues. 

♦ Sociopolitical (educational/legal/economic/political/ cultural) processes and institutions 
can be used to resolve biodiversity issues. 

| in. Actions and Skills 

Students should be able to: 

♦ identify changes in biodiversity at their local level. 

♦ investigate and analyze patterns and structural foundations of biodiversity issues. 

♦ synthesize and evaluate gathered information including biographies of conservationists 
and success stories, to identify models and alternate solutions. 

♦ clarify and analyze their own values and priorities held by others on biodiversity issues. 

♦ identify alternative values or priorities held by others on biodiversity issues. 

♦ participate effectively in group problem solving activities. 

♦ effectively communicate ideas and information about biodiversity issues. 

♦ effectively implement selected actions regarding local and global biodiversity problems 

and solutions. . . , 

♦ know how to work cooperatively with others to establish objectives and develop new 

habits of thinking, valuing, and acting. 



III. Development of the Biodiversity Assessment Instrument for Middle School Students 

The following schematic presents an overview of the various steps involved with the 
development of a biodiversity assessment instrument for middle school students. NEETF 
funds were used to support these steps. Again, the process spanned a two-year period. Step 
one (i.e., validation of the framework) was described in the previous section of this paper. 
Each of the additional steps used to develop the instrument are summarized below. 



Steps for Instrument Development 

Validation of Windows on the Wild Biodiversity Education Framework 

4 

Development of Item Pool 

4 

Validation of Item Pool by Teachers and Specialists 

4 

Revision of Item Pool Using Feedback of Validity Panel 

4 

Distribution of Revised Item Pool into Three Pilot Instruments 
May 1995 Pilot with 18 Classrooms 

4 

Analysis of May 1995 Pilot Results 

4 

Development of December 1995 Pilot Instrument 

4 

December 1995 Pilot with 10 Classrooms 

4 

Analysis of December 1995 Pilot Results 

4 

Compilation of Best Performing Items into Final Instrument 

4 

Formative Evaluation of Windows on the Wild Activities 



Development of the Item Pool 

A pool of possible assessment questions needed to be developed which addressed both the 
biodiversity framework and the pedagogic level of the middle school students. Also, as 
directed by the framework, items needed to address both cognitive and affective aspects of 
biodiversity literacy. 

A literature search was conducted in an attempt to identify existing test items that could be 
used. Only a few items were collected or revised from existing environmental literacy 
assessment instruments (Peri, 1996; Quale, 1993; Schurr, 1992; and WRI, 1992/93). 

Ultimately, an item pool was drafted by the research staff. Most of the cognitive items were 
written as multiple choice questions. They were written to address both the biodiversity 
framework and Bloom’s Taxonomy of Educational Objectives (Bloom, 1956). Over one 
hundred items were written to address the cognitive domain. A higher proportion of the 
items were written at the levels of knowledge, comprehension and application levels of 
Bloom’s taxonomy than were written at the levels of analysis, synthesis and evaluation. 
Although this is a common evaluation flaw (Tuckman, 1975), it was accepted as a limitation 
of this testing instrument in light of the fact that higher levels of thinking would be addressed 
in other components of the Windows on the Wild program evaluation. 

Likert-type items (i.e., strongly agree to strongly disagree) were written to address the 
affective components of the framework. Again, only a few of the items came directly or 
were modified from existing instruments (Peri, 1996; and Quale, 1993). Over one hundred 
items were developed to address the affective domain. They were written to measure 
outcomes of environmental sensitivity, values, locus of control, assumption of personal 
responsibility, and assumption of societal responsibility. These various areas were then 
treated as potential subscales. 

Draft items were sent to relevant teachers and other education specialists for formal review 
(Appendix D). Each item was placed into a matrix that asked for a response evaluating four 
areas: content validity, difficulty, accuracy, and distracters (distracters are the incorrect 
options to a question and were only evaluated for the multiple choice items). The reviewer 
was asked to rate each area for each item by circling a number on a scale of 1-4. Space was 
also provided for additional comments, which were strongly encouraged. As a result of this 
external review numerous items were rewritten or eliminated. 

Piloting Testing 

Following the final reviews and revisions, the item pool was left with a total of 196 
assessment items. These were considered the best questions from the original pool and the 
research staff felt confident these questions would have the best potential for scoring well in 
the rigorous item analysis that would occur as a result of piloting. 

It was determined by the PESC that three pilots should be conducted. The first pilot would 
emphasize item analysis. From the results, items would be selected to develop a draft 
biodiversity literacy assessment instrument. This instrument would then be piloted to 



evaluate the effectiveness of the whole test. The third pilot would involve using an 
instrument to test the effectiveness of Windows on the Wild curriculum materials. 

The item analysis pilots were conducted in May 1 995 and the draft instrument pilot was 
conducted in December of 1995. The pre-test post-test formative evaluation of Windows on 
the Wild activities was conducted in April 1996. 

Populations used in all pilots were selected based on availability, geographic distribution 
(i.e., across the country and proximity to major urban areas) and teacher awareness of the 
Windows on the Wild program. Specific population used in each pilot are presented in 
Appendix E. Generally, students in the pilots came from Washington, DC, Atlanta, GA, 
Rochester, NY, Chicago, IL, and Seattle, WA. 

Item Analysis Pilots (May 1995) 

For the item analysis pilots items were assembled into three different pilot test instruments. 
This was done because there were too many items to put into one instrument. An effort was 
made to equally distribute the items among the three tests according to the framework so that 
each pilot contained items that tested every portion of the framework. An effort was also 
made to assure that similar but opposing items were placed on different pilots. For example, a 
value statement that was worded positively was placed on a different pilot than the same 
value statement that was worded negatively. This was done for comparison purposes during 
the analysis. 

Each pilot included a few introductory questions asked to gather some basic information 
about the student population, including gender, interest in environmental topics, and source 
of environmental knowledge. Students were also asked to identify themselves as average, 
below average, or above average regarding their knowledge about the environment. This was 
done to determine if items could discriminate between those who are possibly more 
knowledgeable vs. the average students. 

The three pilot tests (Pilots A, B, and C) were sent to a total of 18 classrooms (six classes per 
pilot). Most of the teachers involved (all but three) had been item reviewers and had 
expressed interest in piloting with their students. The teachers were sent detailed instructions 
to read to their classes. Scantron scoring sheets were sent and pencils were provided. In 
addition, slips of paper with a definition of biodiversity were provided for every student. 
This was done because there was concern about the language difficulty of the items. The 
definition was very basic and did not answer any of the questions included on a pilot (see 
Appendix F for letter, instruction pages, and definition as provided to the teachers.) 

Teachers were also asked to answer a few questions about their class and to identify students 
whom they considered to be “particularly knowledgeable and concerned about the 
environment and environmental issues.” This information was asked so that teacher 
responses could be compared to student responses to a similar question. Because the pilots 
were sent at a busy time of the school year, teachers were given the remainder of their school 
year to conduct the pilot and return the answer sheets. 
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Answer sheets were received from all classrooms and prepared (i.e., cleaned up) for 
mechanical scoring. Answer sheets were scanned at the Information Technology Office at 
the University of Wisconsin-Stevens Point. The response data was then analyzed by 
researchers at the WCEE using the SPSS statistical software package. 

Results of item analysis are in Appendix E. Following is an overview of the analysis and 
criteria that were used to evaluate and select items for the draft instrument that would be used 
in the second pilot. Items were considered to have potential based on the following criteria. 

Affective Items: 

1 . if the item were deleted from the subscale, the reliability of the subscale would be 
decreased (the decrease in alpha if the item was removed was > .0050) 

2. the correlation of the item to other items within the same subscale (i.e., same part of 
framework) was > .25 

3 . the mean score of the item was between 1 .0 and 2.0 on the recoded scale of 0-3 

4. the standard deviation was >.75 (A high standard deviation indicates a high range of 
responses, which is desirable in a study that is measuring change.) 

5. responses were distributed among the choices of “strongly agree” to “strongly disagree 

6. there was evidence that the item was part of a subscale that discriminated between the 
general population and students identified as more environmentally aware 

Cognitive Items: 

1 . if the item were deleted from the subscale, the reliability of the subscale would be 
decreased (the decrease in alpha if the item was removed was >.0050) 

2. the correlation of the item to other items within the same subscale (i.e., same part of the 
framework) was >.25 

3. a higher percentage of students scoring in the top quintile groups selected the preferred 
answer (indicated by a positive discrimination score) while higher percentages of students 
in the bottom quintile groups selected each distracter (indicated by negative 
discrimination scores) 

4. the foils or distracters were selected at roughly equivalent rates or each was selected by a 
minimum of five percent of the students 

5. the difficulty factor of an item ranged from .50 to .75 

6. there was evidence that the item was part of a subscale that discriminated between the 
general population and students identified as more environmentally aware 



Instrument Pilot (December 1995) 

Researchers at the WCEE selected the best items from the May 1995 pilots and compared 
them to the framework to determine how well they covered the various components of the 
framework. Some sections of the framework had several items that had performed well and 
some had very few. An overview of how items progress (i.e., number of items relative to 
framework) from the pilots to selection for the final draft instrument is presented in Appendix 
E. To cover weak areas, new items were drafted or old items were again revised. A test of 
158 questions was developed for the second pilot. 

The pilots were conducted with students from the same pilot areas used in the May 1995 
pilots (Appendix F). However, fewer classrooms were involved since teachers had to agree 
to administer the test over two class periods. The same item analysis procedures were used 
in the December pilot as were used to evaluate items in the May pilot. 

Results of item analysis relative to the December pilot are presented in Appendix G. It was 
from this pool that items were selected to develop an instrument to be used in exploring the 
effectiveness of the Windows on the Wild curriculum. 

Discrimination Ability of the Pilot Instruments 

As described earlier, each of the pilots asked students to rank themselves as above average, 
“average,” or “below average” when it came to understanding problems about the 
environment. Teachers were also asked to similarly rank the students in their classes. The 
self- identified, teacher-identified and double-identified (i.e., both teacher and self identified) 
responses were analyzed as separate populations and the results were then compared to the 
non-identified students (Appendix H). These results helped to determine if subscales 
discriminate between environmentally aware students and the general population. 

IV. Formative Assessment of Select Windows on the Wild Activities 
Development of Formative Evaluation Instrument 

In April 1996, a biodiversity instrument was constructed from the item pool that was piloted 
in December 1995. This instrument was constructed with the intent of using it to determine 
its potential for evaluating the effectiveness of select Windows on the Wild activities. The 
instrument was administered as a pretest-posttest evaluation. It was hypothesized that if the 
curriculum was effective (i.e.; relative to the biodiversity framework) and the instrument was 
adequately sensitive, theoretically, a significant change in test scores would occur from pre to 

post. 

Because of the large number of items in the December pilot, a test had to be developed with 
considerably less items and time commitment. Teachers repeatedly suggested that the 
instrument should not take more than one class period to complete. As in the previous pilots, 
items for the April pilot were again selected relative to the framework and strength of the 
item analysis results. The formative evaluation instrument ultimately consisted of nine 
introductory/demographic items, thirty-nine affective Likert items, and thirty-two cognitive 
multiple choice items (Appendix I). The test was also characterized by three potential 



subscales. Questions 1 1-30 established what was titled the efficacy subscale. These 
questions related to the students’ feelings of personal control, hopefulness/hopelessness, 
personal responsibility, and the responsibility of others relative to maintaining the integrity of 
biodiversity. Questions 10, 31-48 established the attitudes/values subscale. Questions 49-80 
established the cognitive or knowledge subscale. 

Three teachers were identified who agreed to use the set of Windows on the Wild activities 
and pre/posttest their students. The teachers names and locations are presented below. 

Alisa Benway and Connie Skelton Jean Kellogg 

Williamsberg Middle School Briar-Terrace Middle School 

3600 N Horizon St. 22200 Brier Rd. 

Arlington, VA 22207 Brier, WA 

N=81 students N=93 students 

These teachers received the following materials. 

1 . Instructions for conducting the activities and tests. 

2. Testing booklets, Scantron answer sheets 

3. Five Windows on the Wild Activities 

4. Various student resources needed to run the activities. 

The activities sent to the teachers were selected from the introductory module (i.e., 
Biodiversity Basics) to the Windows on the Wild curriculum. These activities were selected 
because collectively they addressed a fair amount of the biodiversity education framework. 
The titles of the activities are listed below. Copies of the activities can be requested from the 
World Wildlife Fund. 

1 . What’s Your Biodiversity IQ? 

2. Biodiversity-The Spice of Life 

3. Panthers and Hippos.. .Oh My! 

4. Secret Service Part I 

5. Future Worlds 

Teachers were asked to give the pretest prior to any discussion of biodiversity concepts with 
the students. Following the pretest, they were asked to conduct the five activities within a 
two- week span. They were to spend no more than one class period on each activity. A total 
of one hundred seventy-four pretests and post tests were returned by the teachers. 

Results from Formative Evaluation Instrument 

Item by item results (frequencies) of the whole group (i.e., both classes combined pre and 
post test scores) are found in Appendix J. Pre and post test scores by subscale relative to the 
whole population are presented in Appendix K. 



On the attitude/value subscale there was a significant pre-post change for the whole 
population and for each of the individual classes. For the cognitive subscale, there was a 
significant pre-post change for the whole population and for the Washington class (assuming 
.05 as the minimum significance level). No significant change occurred in the Arlington 
class. Relative to efficacy, no significant change occurred in either class. 

These findings would suggest that the activities may have had some effect on the attitudes 
and values of the students. Results also indicate that there is potenital for cognitive change. 
The lack of any significant change in perceived efficacy is interesting. Either the activities 
did not address this concept, the test was not sensitive enough to detect change, or students 
have an efficacy profile that is well established.. 

This pilot seems to suggest that the activities did have some impact and that the test was 
sensitive enough to detect some change in affective and cognitive disposition of the students 
as a result of experiencing the Windows on the Wild activities. It is important however to 
note that this was only a pilot exercise and to suggest real change as result of using the 
activities or to confirm the sensitivity of the test will require a more thorough study using 
appropriate control groups. 

IV. Conclusions and Recommendations 

Use of the Biodiversity Education Framework and Item Pool 

The biodiversity education framework that was developed as part of the project can be used 
to guide the development of a comprehensive biodiversity education program or to develop 
an educational program on a select aspect of biodiversity. The framework could be used to 
guide program development at the adult or youth levels. The framework provides the 
collective thoughts of relevant professionals around the country as to what concepts should 
be taught under the umbrella of biodiversity literacy for the general citizenry. 

Thus far, indications are that the biodiversity item pool developed in this project has potential 
for yielding the development of evaluation tools to test levels of biodiversity literacy among 
populations of middle school students. Of course, there are many variables that effect the 
reliability and validity of a test in any given situation. 

The item pool might be used to evaluate biodiversity literacy of middle school students in 
general or as a tool to potentially measure change as a result of an educational program. If 
the intent is to measure the general level of biodiversity literacy in students at any given time, 
then questions should be sampled from the item pool which reflect all aspects of the 
biodiversity framework. Because no national norm for the test exists, results would have to 
be interpreted relative to expectations of the evaluator(s) (i.e., given particular results or 
scores, does the evaluator(s) feel the students did well or not). 

If the intent is to measure change in students as a result of an educational program, then it is 
recommended that items be selected that relate as closely as possible to the objectives of the 
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program or activities students will experience. A pre/posttest methodology would then be the 
most effective approach. 

Future Evaluation of Windows on the Wild Using the Biodiversity Item Pool 

The pilot evaluation of activities from the first Windows on the Wild module showed promise 
both in terms of the effectiveness of the curriculum and in terms of the effectiveness of the 
biodiversity item pool to discriminate change as a result of a relevant educational program. 

Although Windows on the Wild materials are still being developed, plans are being made to 
conduct a more comprehensive assessment of the materials using the biodiversity item pool. 

A pre-test post-test evaluation will be conducted using a stronger research design than was 
used in the May 1996 pilot. A Solomon Four-Group Design will be used in the next round of 
testing. Also, more definitive results may be obtained with a more comprehensive set of 
activities. 

Summary of Products Resulting From NEETF Funding 

The NEETF funds played a very important role in helping to pursue and develop biodiversity 
education of adults and youth in this nation. Specifically, NEETF funds supported the ... 

1 ) development of a biodiversity education framework that can guide the development of 
educational materials or programs that hope to improve biodiversity literacy. 

2) development of a pool of test items that can be used to explore what middle school 
students feel and know about the concept of biodiversity. 

3) development of an evaluation instrument that can potentially be used to test the 
effectiveness of middle school biodiversity education programs. 

4) professional development of an individual pursuing a MS degree in environmental 
education. AnneMarie VanDam served as research assistant in the project which 
ultimately contributed to the completion of her thesis, graduation and present 
employment as Communications Coordinator at the Grand Traverse Regional Land 
Conservancy. 
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Framework Validation 



o 

ERIC 
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Sample letter and evaluation form sent to framework validity reviewers 

Talbert B. Spence Au 8 ust 1 9 ’ 1 994 

Dept, of Education - American Museum of Natural History 
Central Park W at 79th St. 

New York, NY 10024-5192 

Dear Mr. Spence: 

The Wisconsin Center for Environmental Education (WCEE) at the University of 
Wisconsin -Stevens Point and World Wildlife Fund (WWF) are working together to develop 
an assessment of "Windows on the Wild" - a national biodiversity program being developed 
by WWF. Before WWF starts to develop materials, training designs, and evaluation strategy, 
it is important that the "Windows on the Wild" biodiversity education framework is validated 
by experts in the field. The draft framework included here has been compared to other 
environmental education frameworks in a document called the National Environmental 
Education Standards, which is being developed by the North American Association for 
Environmental Education (NAAEE). 

We are asking that you help us validate the appropriateness and completeness of the 
framework. WWF will initially be using the framework to create a middle school instrument 
to assess biodiversity literacy. They will also be using the framework to develop biodiversity 
education materials for middle school students, secondary students, and the general public, 
and for developing workshop designs for educators. 

Please review the enclosed framework, making any changes you feel are necessary 
directly on the copy, and complete the Validity Assessment. I would appreciate it if you 
could send the framework and Validity Assessment to me by September 6. If you can't meet 
the deadline or have any questions, I can be reached at (715) 346-4950. And if you have any 
questions about "Windows on the Wild" or other aspects of WWF’s program, please call Judy 
Braus, Director of Environmental Education, at WWF. Her direct number is (202) 778-9542. 

I will be calling you soon to find out if and when you will be attending the NAAEE 
meeting in Cancun this September. We are planning to have a short meeting with as many 
members of our team as possible to discuss the framework and our plans for the assessment 
(see enclosed half sheet). If you can’t come, we'll call you after the conference to get your 
input. 

Thanks again for agreeing to work with us on the development of this assessment. We 
look forward to your comments and feedback. 

Sincerely, 



AnneMarie VanDam - Wisconsin Center for Environmental Education 

Enel: "Windows on the Wild" Biodiversity Framework 

"Windows on the Wild" Framework Validity Assessment form 
Scheduling sheet for NAAEE Conference 

O 

ERLC 
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Windows on the Wild Biodiversity Framework 
Validity Assessment 

1. To what extent does this framework reflect the relevant topics and issues 
concerning the concept of biodiversity? 

0 1 2 3 4 5 

Don’t know Not at all Slightly Moderately Considerably Completely 

Comments/Suggestions: 



2. How well does the theme of "biodiversity" act as an umbrella or organizing 
theme for an environmental education curriculum? 

0 1 2 3 4 5 

Don't know Not at all Slightly Moderately Considerably Completely 

Comments/Suggestions: 



3. To what extent does this framework reflect the current views and literature on 
environmental literacy? 

0 1 2 3 4 5 

Don’t know Not at all Slightly Moderately Considerably Completely 
Comments/Suggestions: 





33 



4. To what extent is this framework relevant for the broader educational 

community with interests in EE (e.g., science education, social studies education, 
geography education, health education)? 

0 1 2 3 .4 5 

Don't know Not at all Slightly Moderately Considerably Completely 

Comments/Suggestions: 



5. To what extent is this framework relevant for use with formal environmental 
education programs? 

0 1 2 3 4 5 

Don't know Not at all Slightly Moderately Considerably Completely 

Comments/Suggestions: 



6. To what extent is this framework relevant for use with non-formal 

environmental education programs (as in zoos, museums, nature centers, and 

so forth)? 

0 _1 2 3 4 5 

Don’t know Not at all Slightly Moderately Considerably Completely 

Comments/Suggestions: 



To what extent is this framework appropriate for use as a construct in the 
development of an instrument to assess biodiversity literacy? 



0 1 2 3 4 _5 

Don't know Not at all Slightly Moderately Considerably Completely 



Comments/Suggestions: 



Appendix D 



Item Reviewers, Process Forms, and Results 



Teacher evaluators of the original item pool 



Dan Bogan 

Sidwell Friends School 
Washington, D.C. 

Marc Chappe 
Conner’s Emerson School 
Bar Harbor, ME 

Diana Cohn 
T eacher/Education 
Coordinator 
New York, NY 

Sandy Cravens 
Palestine Middle School 
Palestine, TX 

Daniel Dunne 
Monroe Middle School 
Rochester, NY 

Catherine Elk 
Bar Harbor, Maine 

Jenna Glock 

Komachin Middle School 
Lacey, WA 

Terry Greene 
Lanier Middle School 
Buford, GA 

Dianne Hall 
Lanier Middle School 
Buford, GA 

Marcia Halverson 
Shiloh Middle School 
Lithonia, GA 



Leslie Henning 

Frank Wagner Middle School 

Monroe, WA 

Debbie Hill 
Lanier Middle School 
Buford, GA 

Terese Johnston 

George Washington Middle 

School 

Alexandria, VA 
Sallie Kirby 

Pickneyville Middle School 
Norcross, GA 

Bill Kreigle 

Montgomery County School 
System 

Rockville, MD 

Doug Llewellyn 
Rochester City School 
District 
Rochester, NY 

Beth Locallo 
Chicago, IL 

Kathryn Peecher 
Revere School 
Chicago, IL 

Chris Pellikan 
Field School 
Chicago, IL 



Jenny Poole 
Lanier Middle School 
Buford, GA 

Catherine Rozi 
Harborside, ME 

Peggy Swenor 
Petoskey Middle School 
Petoskey, MI 

Jose Veras 

Monroe Middle School 
Rochester, NY 

Julie West 
North Tapps School 
Sumner, WA 

Marcia Wiley 
EE Coordinator 
Seattle, WA 

Paul Winkler 
Pemetic School 
Southwest Harbor, ME 

David Wood 
Sidwell Friends School 
Washington, D.C. 

Terri Wright 
Petoskey Middle School 
Petoskey, MI 



Non-teacher evaluators of the original item pool 



Biodiversity Specialists : 

Rich Block 
World Wildlife Fund 
Washington, D.C. 

Dr. Eric Anderson 

Professor of Wildlife 

University of Wisconsin - Stevens Point 

Jeff Bryant 

Education Program Curator 
Monterey Bay Aquarium 
Monterey, California 

Multicultu ral/Language Specialists: 
Mary Schleppegrel 
Linguistics Department - UC Davis 
Davis, CA 

Carmel Ervin 

Secondary Education Specialist 
National Museum of Natural History 
Smithsonian Institution 
Washington, D.C. 

Diane Boardley-Suber 
Assistant Provost 
Hampton, VA 

Dr. Louvenia Gaffney 
Vimey Elementary School 
Washington, D.C. 



Environmental Edu cation Specialists: 
Janet Ady 

Fish and Wildlife Service 
Washington, D.C. 

Lori Mann, Education Director 
Coyote Point Museum 
Burlingame, CA 

Ed McCrea 

North American Association for EE 
Washington, D.C. 

Bill Andrews 

Consultant, Science and EE 
California Dept, of Education 
Sacramento, CA 

Educational Evaluation Specialists: 
Dr. Lou Iozzi 
Rutgers University 
Caldwell, NJ 

Dr. Joe Heimlich 
E.R.I.C./Ohio State University 
Columbus, OH 

Dr. Martha Monroe 
Environmental Education Consultant 
Takoma Park, MD 

Dr. Paul Hart 
University of Regina 
Saskatchewan, Canada 



Sample letter, instructions, and evaluation form 
sent to original item pool evaluators 



February 9, 1995 

Dear ’ World Wildlife Fund (WWF) is currently developing a variety of interdisciplinary 
education materials to help middle school students understand biodiversity issues and their 
connection to them. The materials will emphasize community investigations, use of real data 
and case studies, communication skills, and critical thinking skills. To date we ve developed 
WOW! — a biodiversity primer for middle school students that provides an overview of 
biodiversity issues through fiction and nonfiction articles. The primer will serve as a reading 
component to the program and will complement the Windows on the Wild curriculum 
materials WWF is now writing. (A copy is included for you.) 

WWF is also working with the Wisconsin Center for Environmental Education 
(WCEE) to develop a survey instrument to gather baseline data on what students currently 
know and feel about biodiversity-related issues. The instrument will be used before and after 
students use the Windows on the Wild curriculum materials. 

To ensure that the instrument is valid and reliable, we need professionals like yourself 
to review the items and provide us with feedback. We have developed a pool of 
approximately 200 questions. We’d like you to review about 100 of these questions looking 
at four critical areas: match to program objectives, readability, accuracy, and appropriateness 
of incorrect responses. (Specific review directions are included on page III. of this packet). 

Once the instrument is developed, we will pilot it with students in classrooms across 
the country and make additional revisions based on the results of the pilot test. If you are a 
teacher and would be interested in piloting versions of the instrument this spring or next year, 
please let us know by checking “yes” on the cover sheet of this packet. 

If you would like more information about the assessment or about the Windows on the 
Wild program, please call Margaret Pennock at 202-778-9503. She will also be happy to keep 
you posted on additional ways you can be involved in the development and implementation 
of Windows on the Wild. 

Thank you very much for agreeing to participate in this part of the assessment 
process. Your feedback will help us develop a high-quality instrument that can gather 
baseline data about student knowledge and attitudes. Please mail your materials back to 
WCEE by February 25. As a small token of our appreciation, WWF will be sending you a 
$100 honorarium within a few weeks of receiving your feedback. 

Thanks again for your willingness to assist with this project. 

Sincerely, 



Judy Braus 

Director of Environmental Education 



INSTRUCTIONS FOR ITEM EVALUATION 



Thanks again for helping us with the development of this assessment. To make your 
job easier, we included only one or two items on each side of the page. At the top of each 
page, you’ll find an objective. Each objective corresponds to the Windows on the Wild 
Outline for Instrument Development (pp. IV-V of the packet). We recommend that you look 
the outline over now and refer to it as you read each item. 

Below each objective, you’ll find one or more items. Some items are multiple choice 
with 4 possible answers. The correct answer to each multiple choice question is shown with 
an arrow (<=>). Other items are based on a likert scale and help to measure attitudes, values, 
and beliefs. 

Directly below each item are four rating scales for you to complete. Descriptions of 
each are given below. You are asked to respond to each scale on this basis: 

ITEM EVALUATION SCALE: 1 = lowest rating; 5 = highest rating 

Content Validity: Does the item adequately address the objective to which it 

corresponds? 

Is the item clearly written in language that 7th and 8th graders should 
be able to understand? If not, how would you change it to make it 
more readable? 

Is there clearly a scientifically-correct answer to the multiple-choice 
items? Do the attitude items offer non-biased options for students? 

Are the distracters too obvious or too difficult? Can you think of a 
distracter that might be more appropriate? (A distracter is any of 
the incorrect answer options in multiple-choice test items. Students 
who are not familiar with the information are more likely to choose 
a good distracter than the correct answer. Students who are familiar 
with the information should be able to clearly choose the correct 
answer.) 

Your comments are probably the most valuable feedback you can 
give us. This includes editing or rewriting items if they can be 
improved. 

After you have reviewed the items on each page, please return the packet to us in the same 
envelope it came in (postage and mailing label enclosed). Please mail by March 17, 1995. 

If you have any questions about the format or process, don’t hesitate to call AnneMarie 

VanDam at: 

Wisconsin Center for Environmental Education 
403 LRC - University of Wisconsin 
Stevens Point, WI 54481 
Phone: (715)346-4950/Fax: (715)346-3025 



Readability: 

Accuracy: 

Distracters: 

Comments: 
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Item Evaluation Packet 



Please return this sheet with your items. 

$ NAME and 

ORGANIZATION: 

$ Best Mailing Address and Phone # to reach you: 



$ Can you recommend a 7th or 8th grade teacher who may be interested in piloting the 
biodiversity assessment with their class? If so, please write their name, school, and a 
way to contact them. Thank you! 



PLEASE CHECK TO MAKE SURE THAT YOUR PACKET CONTAINS THE 
FOLLOWING ITEMS: 

1. Instructions for Item Evaluation sheet 

2. Windows on the Wild Outline for Instrument 

Development (2 pages) 

3. 24 pages of item evaluation forms (back to back) 

NOTE: If you are missing any of these items , please contact AnneMarie VanDam 
at the Wisconsin Center for Environmental Education. Phone:(715) 346-4950 or 
Fax: (715) 346-3025 



ITEM EVALUATION FORM 



OUTLINE: IA. Knowledge of Ecological Principles and 

OBJECTIVE Processes Related to Biodiversity 

1. Three Levels of Biodiversity 



Question # 1 : Biodiversity includes: 

ci> a. genetic, species and ecosystem diversity. 

b. species diversity only. 

c. species and ecosystem diversity. 

d. genetic and species diversity. 

Content Validity Readability Accuracy 

12345 12345 12345 

COMMENTS: 



Distracters 
1 2 3 4 5 



****************************************************************** 



Question# 2: 



Match the letter below with the phrase that most correctly 
describes it: 

a. mo untains , deserts, rainforests, grasslands 

b. prairie dogs, red-tailed hawks, field mice, orchids 

c. panther, cougar, mountain lion, puma 

genetic diversity (c) 

ecosystem diversity (a) 

species diversity (b) 



Content Validity 
1 2 3 4 5 
COMMENTS: 



Readability 
1 2 3 4 5 



Accuracy 
1 2 3 4 5 



Distracters 
1 2 3 4 5 



ERiC 



,5 
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Numerica l results from original item pool evaluation 

* Below are the numerical results of four categories for which the original item pool was 
evaluated. The “Specialist" results refer to the non-teacher reviewers: 
ecologist/biodiversity specialists, multicultural/linguistic specialists, environmental 
education evaluation specialists, and environmental education specialists. Note that only 
content validity and readability results were reported for the Likert items. 

SC = “Specialist” Content Validity TC = Teacher Content Validity 
SR = “Specialist” Readability TR = Teacher Readability 

SA = “Specialist” Accuracy TA = Teacher Accuracy 

SD = “Specialist” Distracters TD = Teacher Distracters 



M = Mean N = Number of respondents 1 = lowest rating 5 = highest rating 
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SC = “Specialist” Content Validity 
SR = “Specialist” Readability 
SA = “Specialist” Accuracy 
SD = “Specialist” Distracters 



TC = Teacher Content Validity 
TR = Teache- Readability 
TA = Teacher Accuracy 
TD = Teacher Distracters 



M= Mean N = Number of respondents 1 = lowest rating 5 = highest rating 
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6 


3.5 


8 


48 


4.6 


7 


4.3 


10 


4.6 


7 


4.1 


10 


4.6 


7 


3.8 


9 


3.8 


6 


3.3 


7 


49 


4.4 


7 


4.2 


10 


4.6 


7 


3.9 


10 


4.0 


7 ; 


3.3 


9 


3.4 


7 


3.4 


10 


50 


4.2 


5 


4.4 


8 


3.0 


6 


3.9 


8 


3.2 


5 


4.2 


6 


4.2 


5 


3.5 


8 


51 "I 


5.0 


7 


4.6 


8 


4.9 


7 


4.2 


9 - 


5.0 


6 


4.2 


9 


4.1 


6 


4.3 


6 


52 


4.9 


7 


4.3 


8 


4.4 


7 


3.9 


9 


4.4 


7 


3.9 


9 


4.4 


7 


3.8 


8 


53 


4.7 


6 


4.8 


9 


4.8 


5 


4.2 


9 


4.8 


6 


4.6 


8 


4.3 


6 


3.9 


9 


54 


4.5 


6 


4.7 


10 


5.0 


6 


4.7 


10 


4.8 


6 


4.7 


9 


4.8 


6 


3.9 


10 


55 


4.6 


7 


4.4 


8 


4.6 


7 


4.5 


8 


5.0 


7 


3.4 


7 


4.4 | 


7 


4.0 


1 8 


56 


4.9 


7 


5.0 


8 


4.9 


7 


5.0 


8 


4.4 


7 


4.9 


7 


4.7 


6 


4.9 


8 


57 


3.9 


7 


4.8 


8 


4.6 


7 


4.8 


8 


4.4 


7 


4.3 


7 


4.8 


6 


4.1 


8 


58 


4.5 


4 


3.7 


6 


4.0 


4 


3.1 


7 


4.3 


4 


3.4 


5 


3.5 


4 


3.4 


7 


59 


4.4 


7 


4.7 


9 


5.0 


7 


4.7 


9 


5.0 


7 


4.4 


9 


5.0 


7 


3.4 


9 


60 


4.4 


7 


4.9 


9 


4.7 


7 


4.9 


9 


4.6 


7 


4.9 


9 


4.3 


6 


4.6 


9 


61 


4.3 


7 


5.0 


9 


4.4 


7 


5.0 


9 


4.6 


5 


4.8 


9 


3.8 


6 


4.7 


9 


62 


4.3 


7 


4.9 


9 


4.3 


7 


4.9 


9 


3.7 


7 


4.1 


9 


3.7 


7 


4.1 


9 


63 


5.0 


7 


4.4 


9 


5.0 


7 


4.1 


9 


4.4 


7 


4.0 


9 


4.1 


7 


3.2 


9 


64 


4.3 


6 


4.6 


10 


4.3 


6 


4.2 


10 


4.3 


6 


4.1 


9 


4.2 


5 


3.4 


10 


65 


4.7 


7 


4.6 


10 


4.3 


7 


4.2 


10 


4.8 


7 


4.1 


9 


4.1 


6 


4.2 


10 


66 


4.7 


7 


4.9 


8 


4.9 


6 


4.9 


8 


4.4 


7 


5.0 


7 


3.8 


7 


5.0 


8 


67 


4.4 


7 


4.6 


8 


4.4 


7 


4.5 


8 


4.3 


7 


4.3 


7 


4.3 


7 


4.6 


8 


68 


4.7 


7 


4.8 


9 


4.7 


7 


4.6 


9 


4.6 


7 


4.4 


9 


4.2 


6 


3.9 


9 


69 


4.9 


7 


5.0 


9 


4.6 


7 


4.9 


9 


4.7 


7 


5.0 


9 


4.2 


5 


4.5 


6 


70 


4.9 


7 


4.8 


9 


4.4 


7 


4.3 


9 


4.4 


7 


4.3 


9 


4.4 


7 


4.0 


9 


71 


4.7 


7 


4.4 


9 


4.3 


7 


4.4 


9 


4.3 


7 


4.4 


9 


4.1 


7 


4.1 


9 


72 


4.2 


6 


4.2 


10 


4.3 


7 


3.8 


10 


3.4 


7 


3.6 


9 


3.9 


5 


3.9 


9 


73 


4.9 


7 


4.5 


liL 


4.7 


7 


4.5 


10 


4.7 


7 


4.1 


9 


5.0 


6 


3.8 


9 
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SC = “Specialist” Content Validity TC = Teacher Content Validity 
SR = “Specialist” Readability TR = Teacher Readability 

SA = “Specialist” Accuracy TA = Teacher Accuracy 

SD = “Specialist” Distracters TD = Teacher Distracters 



M - Mean N = Number of respondents 1 = lowest rating 5 = highest rating 





SC 




TC 




SR 




TR 




SA 




TA 




SD 




TD 




ITEM# 


M 


JV 


M 


JV 


M 


JV 


M 


N 


M 


/V 


M 


N 


M 


N 


M 


N 


74 


4.7 


7 


4.7 


10 


5.0 


7 


4.5 


10 


5.0 


7 


4.8 


9 


4.6 


7 


4.3 


10 


75 


5.0 


6 


4.6 


10 


5.0 


7 


4.5 


10 


4.8 


6 


4.6 


9 


4.1 


7 


4.2 


10 


76 


5.0 


7 


4.8 


8 


4.7 


7 


4.8 


8 


5.0 


7 


4.3 


7 


5.0 


6 


4.1 


7 


77 


4.7 | 


7 


4.0 


8 


4.6 


7 


4.5 


8 


4.7 


7 


4.1 


7 


4.8 


6 


4.1 


8 


78 


4.9 


7 


4.7 


9 


4.7 


7 


4.7 


9 


4.7 


7 


4.9 


9 


4.0 


6 


4.0 


7 


79 


4.4 


7 


4.4 


9 


4.1 


7 


3.9 


9 


3.5 


6 


3.8 


9 


3.5 


6 


3.1 


9 


80 


4.9 


7 


4.8 


10 


5.0 


7 


4.9 


10 


4.8 


6 


4.7 


9 


4.8 


6 


4.3 


10 


81 


4.9 


7 


4.7 


9 


4.5 


7 


4.4 


9 


4.6 


7 


4.6 


8 


4.8 


6 


4.1 


9 


82 


4.9 


7 


4.4 


10 


4.6 


7 


4.0 


10 


4.7 


7 


4.4 


9 


4.3 


7 


3.8 


10 


83 


4.8 


6 


4.8 


10 


4.7 


7 


4.4 


10 


4.9 


7 


4.3 


9 


4.7 


7 


4.0 


10 


84 


4.4 


7 


4.9 


8 


4.1 


7 


3.9 


8 


4.5 


6 


4.6 


7 


4.6 


5 


4.8 


8 


85 


4.9 


7 


5.0 


8 


4.9 


7 


4.6 


8 


4.6 


7 


4.7 


7 


4.9 


7 


4.6 


8 


86 


4.6 


7 


4.7 


9 


4.7 


7 


4.3 


9 


5.0 


7 


4.8 


9 


4.3 


7 


4.6 


9 


87 


4.9 


7 


5.0 


9 


4.9 


7 


4.9 


9 


4.7 


7 


4.9 


9 


4.3 


7 


4.6 


9 


88 


4.3 


6 


4.6 


10 


3.8 


6 


3.7 


10 


4.5 


6 


4.0 


9 


4.7 


6 


3.5 


10 


89 


4.7 


6 


4.4 


10 


3.7 


6 


3.8 


9 


4.0 


6 


4.1 


9 


4.3 


6 


3.5 


10 


90 


4.8 


5 


4.8 


8 


4.2 


6 


4.6 


8 


4.8 


6 


4.9 


7 


4.5 


5 


4.5 


8 


91 


4.2 


6 


4.6 


10 


4.0 


7 


4.2 


10 


4.4 


7 


4.8 


9 


4.7 


6 


4.3 


10 


92 


4.4 


7 


4.4 


10 


4.1 


7 


4.5 


10 


4.1 


7 


4.4 


9 


3.6 


6 


3.9 


9 


93 


4.8 


6 


4.6 


8 


3.8 


6 


4.4 


8 ^ 


4.7 


6 


4.3 


7 


4.5 


6 


4.0 


8 


94 


4.6 


7 


4.1 


9 


4.3 


7 


4.4 


9 


4.6 


7 


4.4 


8 


4.1 


7 


3.8 


8 


95 


4.9 


7 


4.5 


10 


4.8 


6 


4.6 


10 


4.4 


7 


4.4 


9 


4.3 


7 


4.2 


10 


96 


4.9 


7 


4.8 


8 


4.7 


7 


4.8 | 


8 


4.9 


7 


4.3 


7 


4.7 


7 


4.3 


8 


97 


5.0 


7 


4.8 


8 


4.4 


7 


4.6 


8 


4.4 


7 


4.7 


7 


4.9 


7 


4.5 


8 


98 


4.7 


7 


5.0 


9 


4.6 


7 


5.0 


9 


4.0 


7 


4.7 


9 


3.8 


5 


4.2 


9 


99 


4.7 


7 


4.9 


9 


4.7 


7 


4.4 


9 


4.4 


7 


4.4 


9 


4.2 


6 


3.7 


9 


100 


4.3 


6 


4.4 


10 


4.8 


6 


4.3 


10 


4.2 


6 


4.0 


9 


5.0 


6 


3.7 


10 


101 


4.7 


6 


4.5 


10 


4.5 


6 


4.4 


10 


4.7 


6 


4.4 


9 


4.3 


7 


4.3 


10 


102 


5.0 


4 


4.8 


5 


4.5 


4 


4.8 


4 


4.8 


4 


4.5 


4 


5.0 


4 


4.3 


4 


103a 


3.7 


7 


4.8 


9 


4.1 


7 


4.8 


10 


















103b 


3.9 


7 


4.7 


9 


4.4 


7 


4.3 


9 


















104 


3.6 


7 


4.6 


9 


4.7 


6 


4.6 


9 


















105 


5.0 


6 


5.0 


8 


5.0 


6 


5.0 


7 


















106a 


4.8 


6 


4.9 


8 


5.0 


6 


4.7 


7 


















106b 


4.7 


6 


4.8 


8 


4.3 


6 


4.4 


7 


















107a 


3.3 


7 


4.8 


8 


4.3 


6 


5.0 


8 


















107b 


3.3 


7 


4.0 


8 


4.3 


6 


4.4 


8 


















108a 


4.3 


7 


4.9 


8 


4.3 


6 


5.0 


8 


















108b 


5.0 


6 


4.8 


9 


5.0 


6 


4.9 


9 


















109a 


5.0 


6 


4.4 


9 


5.0 


6 


4.8 


9 


















109b 


4.2 


5 


4.4 


8 


4.0 


4 


4.8 


8 














J 
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SC = “Specialist” Content Validity TC = Teacher Content Validity 
SR = “Specialist” Readability TR = Teacher Readability 

SA = “Specialist” Accuracy TA = Teacher Accuracy 

SD = “Specialist” Distracters TD = Teacher Distracters 





SC 




TC 




SR 




TR 




SA 




TA 




SD 




TD 




ITEM# 


M 


N 


M 


N 


M 


N 


M 


/V 


















110a 


4.2 


6 


4.8 


10 


4.5 


6 


4.6 


10 


















110b T 


4.3 


6 


4.4 


10 


4.5 


6 


4.9 


10 


















111 


4.3 


6 


4.4 


10 


4.8 


6 


4.8 


10 


















112a | 


5.0 


7 


4.6 


10 


5.0 


7 


4.8 


10 


















112b 


4.9 


7 


4.7 


10 


4.7 


7 


4.7 


10 


















113 


5.0 


7 


4.6 


10 


5.0 


7 


4.8 


10 


















114 


5.0 


7 


4.6 


8 


4.8 


6 


4.7 


7 


















1 ISa 


4.0 


7 


4.9 


7 


4.8 


6 


4.5 


6 


















115b 


4.7 


7 


4.8 


8 


5.0 


6 


4.6 


7 


















116 


4.9 


7 


4.8 


8 


4.6 


7 


4.9 


7 


















117a 


4.9 


7 


4.8 


8 


4.9 


7 


4.9 


7 


















117b 


4.9 


7 


4.6 


8 


4.1 


7 


4.7 


7 


















118 


5.0 


7 


5.0 


9 


4.9 


7 


4.9 


9 


















119 


5.0 


6 


5.0 


9 


4.8 


6 


4.6 


9 


















120a 


5.0 


6 


4.8 


9 


4.7 


6 


4.0 


9 


















120b 


4.8 


7 


5.0 


9 


4.5 


6 


4.8 


9 


















121a 


4.8 


7 


4.9 


9 


4.8 


6 


5.0 


9 


















121b 


3.9 


6 


4.8 


9 


3.8 


5 


4.6 


9 


















122 


4.6 


7 


5.0 


8 


4.9 


7 


5.0 


8 


















123 


4.9 


7 


5.0 


8 


5.0 


7 


4.9 


8 


















124 


5.0 


7 


4.9 


8 


5.0 


7 


5.0 


8 


















125 


4.9 


7 


4.8 


9 


5.0 


6 


4.7 


9 


















126 


4.6 


7 


4.8 


9 


3.9 


6 


4.5 


9 


















127 


4.6 


7 


4.7 


9 


4.7 


6 


4.6 


9 


















128 


4.9 


7 


3.9 


8 


4.7 


7 


4.9 


7 


















129 


5.0 


7 


4.6 


8 


4.9 


7 


4.9 


7 


















130 


5.0 


7 


4.4 


8 


4.9 


7 


4.4 


7 


















131 


4.9 


7 


4.5 


8 


5.0 


6 


4.6 


7 


















132a 


3.6 


7 


5.0 


8 


4.2 


6 


4.6 


7 


















132b 


3.8 


6 


4.3 


8 


3.8 


6 


4.6 


7 


















133 


5.0 


6 


4.9 


9 


5.0 


6 


4.8 


9 


















134 


5.0 


6 


4.8 


9 


4.5 


6 


4.1 


9 


















135a 


4.7 


6 


4.9 


9 


4.0 


6 


4.7 


9 


















135b 


4.3 


7 


4.8 


9 


4.0 


6 


4.8 


9 


















136 


4.1 


7 


4.2 


9 


3.2 


6 


3.9 


9 


















137 


4.4 


7 


5.0 


9 


4.7 


6 


4.2 


9 


















138 


5.0 


7 


4.8 


8 


4.4 


7 


4.4 


7 


















139 


5.0 


7 


4.8 


8 


5.0 


7 


4.7 


7 


















140 


5.0 


7 


4.8 


8 


4.4 


7 


4.9 


7 


















141a 


4.1 


7 


4.6 


8 


4.3 


6 


4.9 


8 


















141b 


4.2 


7 


4.9 


9 


4.7 


6 


4.8 


9 
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SC = “Specialist” Content Validity 
SR = “Specialist” Readability 
SA = “Specialist” Accuracy 
SD = “Specialist” Distracters 



TC = Teacher Content Validity 
TR = Teacher Readability 
TA = Teacher Accuracy 
TD = Teacher Distracters 





SC 




TC 




SR 




TR 




SA 




TA 




SD 




TD 




ITEM# 


M 


N 


M 


N 


M 


N 


M 


N 


















142 


4.3 


1 


4.9 


9 


3.8 


6 


5.0 


9 


















143 


5.0 


6 


5.0 


8 


5.0 


6 


4.9 


8 


















144 


5.0 


6 


4.9 


9 


4.0 


5 


4.2 


9 


















145 


4.7 


7 


4.7 


9 


4.6 


7 


5-0 


9 


















146 


4.7 


6 


4.7 


9 


4.2 


5 


4.0 


9 


















147 


4.8 


6 


4.2 


9 


4.6 


5 


4.0 


9 


















148 


4.8 


6 


4.3 


9 


4.8 


4 


4.0 


9 


















149 


4.7 


7 


4.9 


7 


3.7 


7 


4.3 


7 


















150 


4.7 


6 


4.6 


8 


4.2 


6 


4.6 


7 


















151 


5.0 


6 


4.5 


8 


4.3 


6 


4.0 


6 


















152 


4.0 


6 


4.4 


9 


3.8 


5 


4.3 


9 


















153 


4.5 


6 


4.3 


9 


4.0 


5 


4.2 


9 


















154 


4.3 


6 


4.1 


9 


4.2 


5 


4.7 


9 


















155 


4.8 


6 


4.4 


10 


3.7 


6 


4.3 


10 


















156a 


4.9 


7 


4.6 


10 


4,4 


7 


4.6 


10 


















156b 


5.0 


6 


4.5 


10 


4.2 


6 


4.2 


10 


















157 


4.7 


6 


4.6 


8 


4.2 


5 


4.9 


7 


















158 


4.2 


6 


4.7 


7 


3.4 


5 


4.9 


7 


















159 


4.3 


6 


4.6 


7 


4.0 


5 


4.7 


7 


















160 


5.0 


6 


4.8 


9 


4.5 


6 


4.8 


9 


















161 


4.7 


6 


4.1 


9 


4.0 


6 


4.1 


9 


















162 


4.2 


5 


4.6 


9 


4.2 


5 


4.4 


9 


















163 


4.9 


5 


4.1 


9 


4.8 


4 


4.1 


9 


















164 


3.4 


6 


4.8 


9 


4.6 


5 


4.7 


9 


















165 


4.6 


6 


4.1 


8 


3.8 


5 


4.0 


8 


















166 


4.4 


7 


5.0 


7 


4.3 


7 


4.8 


6 


















167 


4.4 


5 


4.7 


7 


4.0 


5 


4.6 


7 


















168 


4.7 


6 


4.6 


9 


4.4 


5 


4.4 


9 


















169 


5.0 


5 


4.8 


9 


5.0 


5 


4.8 


9 


















170 


4.3 


6 


4.7 


9 


5.0 


5 


4.8 


9 


















171 


5.0 


7 


4.8 


8 


4.9 


5 


4.3 


7 


















172 


5.0 


7 


4.5 


8 


5.0 


7 


4.9 


7 


















173 


5.0 


7 


4.8 


8 


5.0 


7 


4.7 


7 


















174 


4.3 


6 


4.9 


9 


4.8 


5 


4.9 


9 


















175 


5.0 


5 


4.9 


9 


5.0 


5 


5.0 


9 


















176 


4.1 


6 


4.9 


9 


4.2 


5 


4.9 


9 


















177 


5.0 


7 


4.6 


9 


4.6 


7 


4.6 


9 


















178 


4.5 


6 


4.4 


8 


4.2 


6 


4.5 


8 


















179 


5.0 


7 


4.9 


9 


4.3 


7 


4.8 


9 


















180 


4.2 


7 


4.7 


7 


4.3 


6 


4.7 


6 


















181a 


4.0 


6 


4.6 


8 


3.8 


5 


4.7 


6 


















181b 


4.4 


7 


4.7 


7 


4.7 


6 


4.6 


7 
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SC = “Specialist” Content Validity TC = Teacher Content Validity 
SR = “Specialist” Readability TR = Teac» ,r Readability 

SA = “Specialist” Accuracy TA = Teacher Accuracy 

SD = “Specialist” Distracters TD = Teacher Distracters 



M= Mean N= Number of respondents 1 = lowest rating 5 = highest rating 
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Appendix £ 



Item Analysis Pilot (May 1995) 



Letter, instructions, and definition of biodiversity 
sent to May 1995 piloting teachers 



Dear piloting teacher, May 10, 1995 

Thank you very much for agreeing to pilot the “Windows on the Wild Biodiversity Survey. 
We realize that this is a very busy time of the school year and appreciate your willingness to 
participate. 

As you know, “Windows on the Wild” is World Wildlife Fund’s (WWF) biodiversity 
education program. WWF is currently developing biodiversity curriculum materials for middle 
school students and educators. We are also interested in finding out what middle schoolers know 
about biodiversity issues and how their knowledge, skills, and attitudes change after taking part in 
biodiversity education activities. Over the past six months we have been working with the Wisconsin 
Center for Environmental Education (WCEE) at the University of Wisconsin-Stevens Point to 
develop an assessment instrument, or survey, that will help us evaluate students in some of these 
aspects. 

WCEE compiled a list of questions that could be used in the survey. Educators from around 
the country helped to evaluate each of the questions (you may have been one of the reviewers). 

Using the feedback from reviewers, WCEE revised many of the questions and eliminated others 
before designing the enclosed survey. We will use the feedback we get from you and your students 
on this pilot to further refine the items for a final instrument that will be developed by WCEE this 
summer. The instrument will then be used along with “Windows on the Wild” curriculum materials 
next fall. 

We ask that you tell your students they are participating in a survey about what middle 
schoolers know and feel about biodiversity. (This is explained in more detail in the instructions.) 
Please give the survey to one of your classes during a single class period. You will need 5-10 
minutes to give directions and 40 minutes for the students to complete the survey. We anticipate that 
many students may be unfamiliar with the term “biodiversity” and therefore ask that you write the 
definition on the board for their reference while doing the survey (copies are also provided for you to 
distribute). Other than the definition, you do not need to provide other background information. 

We have enclosed 35 student surveys, 35 answer sheets, instructions, and a postage-paid 
envelope for returning the completed information back to us. If any of these items are missing, let us 
know as soon as possible. 

Before returning the materials, please make sure your classroom code is on each of the 
answer sheets (your code is included in the instructions), and answer and return the questions on the 
sheet labeled “To the Administering Teacher.” Both are important for our analysis. Please return this 
sheet, the student answer sheets, and a copy of the survey with your comments by Monday, June 5. 
If this date is a problem or if you have any questions at all, call AnneMarie VanDam at 715-346- 
4950. 

I also want to remind you that we are looking for teachers to pilot our curriculum materials 
in the fall. If you are interested in taking part, please call Margaret Pennock at 202-778-9503. We’ll 
probably check in with you at the start of the school year to see what your schedule looks like. 
Again, thank you for your help with this phase of what we believe to be a very timely and important 
effort in environmental education. Have a great summer! 

Sincerely, 



Judy Braus 

Director Environmental Education 
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To the Administering Teacher 

Please answer the following questions providing us with important information 
for the analysis of the surveys. Return this form with the student answer sheets. 
Thanks! 

1 . What size community do most of the students live in? (please circle only one) 

a) small (population of community is less than 20,000) 

b) medium (population of community is 20,000 to 100,000) 

c) large (population of community is more than 1 00,000) 

2. How would you describe the students’ knowledge of biodiversity based on their 
exposure in school? 

a) the students have had a lot of exposure to biodiversity and related issues 

b) the students have been exposed somewhat to biodiversity and related issues 

c) the students have received little exposure to biodiversity and related issues 

Comments: ' 



3. We are trying to determine if students who are identified by their teachers as being 
environmentally knowledgeable and sensitive do better on this survey than other students. 
Please list students in this class by first name and last initial who you would say are 
particularly knowledgeable and concerned about the environment and environmental issues. 
These students may not necessarily be the students who are the highest achievers. Your list 
will be kept anonymous - the identified students will be scored as a group and not as 
individuals. (If more than ten, add others on the back of this sheet.) 

1 ) 6 ) 

2) 7) 

3 ) 8 ) 

4) 9) 

5 ) : 10 ) 

4. Please look at one of the surveys and write your own comments about the items and 
format. If possible, make notes about difficulties that students had on particular items as well 
as the amount of time it took for them to complete the survey and return this with the answer 
sheets. 



Thanks again for your input! ! 

O 
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Definition of “Biodiversity” provided to students during May 1995 piloting 
and December 1995 piloting: 



“Biodiversity is another word for the 
variety of life on Barth. It includes 
the different kinds of animals, plants, 
and other organisms, and the variety 
of ecosystems in which they live.” 
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L COGNITIVE OUTCOMES: 

A. Knowledge of Ecological Principles and 
Processes Related to Biodiversity 
1. Three levels of Biodiversity 


Biodiversity includes: 

a) genetic diversity. 

b) species diversity. 

c) ecosystem diversity. 

d) all of the above. 


For the next three questions, match the phrase with the 
answer set (a, b, or c) that most correctly describes it. Use 
each answer set only once. 

genetic diversity 

a) mountains, deserts, rain forests, grasslands 

b) hawk, salamander, black bear, mosquito 

c) red potatoes, banana potatoes, black finger 
potatoes 
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The first link in a food chain is a: 

a) consumer. 

b) producer. 

c) decomposer. 

d) host. 
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Which of the following statements represents the population 
trend for most species? 

a) the population goes up and down 

b) the population stays the same 

c) the population increases 

d) the population decreases 


When a natural disturbance (such as a flood or forest fire) 
occurs in an ecosystem, the species in the region: 

a) would only be affected for a short time. 

b) could recover if enough plants, animals, and other 
organisms survived. 

c) are usually not affected. 

d) are likely to become endangered. 
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When a new species is released into an area, it can threaten 
species already living there by: 

a) competing for food. 

b) competing for shelter. 

c) becoming food for other species. 

d) a and b 
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As the number of humans on the planet increases, plant and 
animal species worldwide: 

a) are more seriously threatened. 

b) increase. 

c) have a better chance of surviving, because there are 
more people to help save them. 

d) are more likely to reproduce. 


What is the most significant effect that an increasing world 
population has on the diversity of plants and animals? 

a) Biodiversity improves. 

b) The amount of available habitat for other species 
becomes less. 

c) The amount of food available for people becomes 
less. 

d) The quality of life for humans goes down. 
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The diversity of species is important in my own life. 


A species can have value just because it is interesting to 
watch. 


It’s OK for our school to make the playground larger even 
if it means harming some endangered plants. 


Plants and animals exist so they can be used by humans. 


Because we get so many medicines from plants and 
animals, it’s imoortant to protect all species. 


I believe it is important to support laws that help protect 
biodiversity. 


III. BELIEFS ABOUT PERSONAL and 
SOCIETAL EFFICACY RELATING TO 
BIODIVERSITY 
(Predictors of Behavior) 


A. Locus of Control 

Subscale Alpha Pilot A = .7857 
Pilot B = .5055 
Pilot C = .6835 


I don’t think I could do anything to help pass a law to 
protect biodiversity, because people like me can’t make a 
difference. (Political Action) 
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I don’t think I could help get a law passed to protect 
biodiversity. But I think other people could help. 
{Political Action! 


If I write a letter to a politician to support a law protecting 
plants and animals, my letter might help get the law passed. 
{Political Action) 


If I found out that my state was trying to pass a law to 
protect biodiversity, I would write a letter to my state 
renresentative supporting it. (Political Action) 


If I wrote a letter to a politician asking for help in 
protecting biodiversity, it wouldn’t matter. Politicians 
don’t listen to DeoDle mv age. (Political Action) 


I could convince my classmates to protect biodiversity. 
(Persuasion) 


I don’t think I could convince my classmates to help 
Drotect biodiversity. (Persuasion) 


r:,— ... * -t ■ ■ — 

It wouldn’t help for me to talk about the importance of 
biodiversity with my family. They only listen to what other 
DeoDle have to sav. (Persuasion) 


I believe that endangered species are doomed, even if I try 
to convince evervone I know to protect them.(Persuasion) 


There is nothing I can do to help endangered species. Luck 
will decide if a species survives or not.(Ecomanagement) 


Even if I do things like recycle and use less water, it won’t 
help protect biodiversity. (Ecomanagement) 
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By recycling, using less water, and doing other things to 
help the environment, I can help protect biodiversity. 
(Ecomanaeement) 


It’s worth my time to do things like recycle and save water 
even if other neoDle don’t. (Ecomanagement) 


I could help protect biodiversity by refusing to buy things 
that harm nlants and animals. (Consumerism) 


Even if I changed my shopping habits and became more 
aware of how they affect biodiversity, I don’t think I could 
helD Drotect Dlants and animals. (Consumerism) 


Even if I refuse to buy things that are harmful to wildlife, 
my actions wouldn’t matter because so many others still 
buv harmful things. (Consumerism) 


Even if I gave only a small amount of money to a group 
that protects biodiversity, my money can help make a 
difference. (Consumerism) 


Whatever happens to a species is going to happen, even if I 
spend a lot of my own money trying to protect it. 
(Consumerism) 


If I saw a person break the law and harm wildlife, it 
wouldn’t do any good to report the person because adults 
don’t listen to someone mv age. (Legal Action) 


I could help protect biodiversity by reporting that a person 
illeeallv harmed wildlife. (Legal Action) 


If I saw people illegally killing wildlife, I don’t think I 
would renort them. (Legal Action) 


If I saw someone illegally harm wildlife, I would report 
that person. (Legal Action) 
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B. Assumptions of Personal Responsibility 

Subscale Alpha Pilot A - .8173 
Pilot B = .7800 
Pilot C®. 7113 


I am not interested in joining a group that is working to 
nrotect biodiversity. 


I want to become involved in an organization that works to 
protect plants and animals. 


I am not interested in joining a group that protects 
hiodiversitv. 


Kids my age don’t need to know about biodiversity. 


Kids my age don’t need to help protect biodiversity, but 
adults should. 


The way I live shows that I want to protect the diversity of 
life 


I would like to make sure that the way I live doesn’t harm 
hiodiversitv. 


It is not my responsibility to try to get my school to do 
things like recycle and use less paper to help protect 

hahitat 


I’d like to help figure out ways our school could do things 

to nrotprt hiodiversitv. 


It is my responsibility to try to get my school to do things 
like recycle and use less paper to help protect biodiversity. 
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C. Societal Responsibility 

Subscale Alpha Pilot A = .8213 
Pilot B = .7146 
Pilot C - .7580 


If every person did their part, we could prevent species 
from coin? extinct. 


It’s OK to pass laws limiting hiking, biking, and other 
human activities to protect an ecosystem. 


People should be able to use bicycles and cars wherever 
thev want, even if it harms an ecosystem. 


It is important that we protect plant and animal habitats, 
even if human activities such as hiking and biking are 
limited. 


We should limit the use of bicycles, boats, and other 
vehicles if thev destroy habitat and endanger species. 


I think people should make changes in their lives that will 
help slow the extinction of species. 


I believe that my friends need to make changes in their 
lives to protect biodiversity. 


■ t 

People should be more concerned about using too many of 

the Earth’s natural resources. 


People of all ages should be learning about the importance 
of biodiversitv. 


People of all ages should be learning about the need for 
biodiversitv. 


People around the world are not responsible for protecting 
endangered species. 


Biodiversity loss is only a problem in other countries. 
People in the U.S. don’t need to take responsibility for it. 
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” Relationship of Items to the Windows on the Wild 
Biodiversity Education Framework 

A -May 1995 -Pilot A B = May 1995 - PUot B C - May 1995 - Pilot C 
D - December Pilot F = Final Instrument 



EVALUATION OUTLINE 


A 1 


B 1 


C 1 


P 1 


F 


I COGNITIVE OUTCOMES 












A. Knowledge Of Ecological Principles And 

Processes Related To Biodiversity 












1. Three Levels of Biodiversity 


1 


1 




1 


1 


a. Genetic Diversity 


2 


1 


2 


3 


2 


b. Soecies Diversity 


2 


2 


1 


2 


2 


c. Ecosystem Diversity 


1 


1 


2 


2 1 


2 


2, Ecological Factors Affecting Biodiversity 












a. Ecosystem change 


1 


1 


1 


2 


1 


b. Evolution and extinction 


3 


1 


3 


2 


1 


3. The Ecological Value of Biodiversity 












a. Ecosystem, structure, function, and 
interdependence 


3 


6 


5 


6 


4 


b. Adaptation and resilience 


2 


2 


3 


2 


1 


B. Knowledge of Problems and Issues Related to 
Biodiversity 












1. Political, Economic, and Social Issues 
Affecting Biodiversity 


2 


1 


1 


2 


2 


a. Habitat Destruction 


1 


1 


2 


2 


2 


b. Introduction of Species 


1 


1 


1 1 


1 


1 


c. Population Growth 


1 




1 


3 


2 


d. Pollution 


1 


2 


1 


2 


2 


e. Overconsumption 


2 


1 


1 


3 


3 


2 The Value of Biodiversity to Humans 










* 


a. Food/Water/Shelter/Oxvgen 


1 


2 








b. Medicine 


1 










c Aesthetics/Pleasure/Recreation 




1 




1 




3 . Science and Technology 






1 


2 




a. Wavs it helps biodiversity 


1 


2 


1 






b Ways it decreases biodiversity 


1 










C. Knowledge of Biodiversity Issue Investigation 
and Action Strategies 












1. Knowledge of strategies used to investigate 
biodiversity problems and issues. 


1 


1 


1 


1 


1 


2. Knowledge of appropriate action strategies 
for the prevention or resolution of 


3 


2 


3 


5 


5 




13 



94 



H. AFFECTIVE OUTCOMES 












A. Sensitivity Towards and Positive Values for the 
Prevention and Remediation of Biodiversity 
Problems and Issues 












1. Sensitivity 


3 


3 


2 




1 


2. Values 


2 


6 


8 


**50 


**18 


B. Beliefs about Personal and Societal Efficacy 
Relating to Biodiversity (Predictors of Behavior) 












1. Locus of Control 
a. Political Action 


3 


1 


1 


2 


1 


b. Persuasion 


1 


1 


2 


2 


1 


c. Ecomanagement 


2 


1 


1 


2 


1 


d. Consumerism 


2 


1 


2 


2 


1 


e. Legal Action 


1 


2 


1 


2 


1 


2. Hopefulness/Hopelessness 








4 


3 


3. Assumptions of Personal Responsibility 


8 


8 


5 


8 


4 


4. Societal Responsibility 


12 


11 


13 


13 


8 



*This part of the framework was represented by several of the Likert items in the final 
instrument. 

**In the December 1995 pilot and the final instrument, most of the “values” items were item 
sets or “clusters.” 




Appendix F 



Populations Used in Piloting 



May 1995 Piloting Teachers 



Washington D.C.: 

Dan Bogan 

Sidwell Friends School 
Washington, D.C. 

David Wood 
Sidwell Friends School 
Washington, D.C. 

Sam Scudder 
Hart Jr. High School 
Washington, D.C. 

Terese C. Johnston 
George Washington 
Middle School 
Alexandria, VA 

Rochester. New York 
Bonnie Bush 
Charlotte Middle School 
Rochester, NY 



Seattle. Wa shington 
Julie West 
North Tapps School 
Sumner, WA 

Lynn Bleaker 
Albert Einstein Middle 
School 
Seattle, WA 

Chicago. Illinois 
Beth Locallo 
Chicago, IL 

Kathryn Peecher 
Revere School 
Chicago, IL 

Katherine Sahlas 
Irving School 
Berwyn, IL 



Atlanta. Georgia 
Jenny Poole 
Lanier Middle School 
Buford, GA 

Terry Greene 
Lanier Middle School 
Buford, GA 

Sallie Kirby 
Pickneyville Middle 
School 

Norcross, GA 



December 1995 Piloting Teachers: 



Julie West (two classes) 
North Tapps Middle School 
Sumner, WA 

Beth Locallo (two classes) 
Chicago, IL 

Dan Bogan/David Wood 
Sidwell Friends School 
Washington, DC 

Jenny Poole 
Lanier Middle School 
Buford, GA 



Terry Greene 
Lanier Middle School 
Buford, GA 

Bonnie Bush 
Charlotte Middle School 
Rochester, NY 



13 j 



Appendix G 



December 1995 Pilot Results 
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Appendix E 



Subscale Analysis Relative to Discrimination 
Between Environmentally Aware Students 
and the General Population 



May 1995 Pilot A: Comparisons of Means between “environmentally literate” (EL) 
groups and the rest of piloting population (RP) (shaded numbers are significant using p < 
.05 as level of significance). (Total N = 173) 



Pilot A: Self-identified environmentally literate students 
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Pilot A: Teacher identified environmentally literate students 
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Pilot A: Double identified environmentally literate students 
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groups and the rest of piloting population (RP) (shaded numbers are significant using p < 
.05 as level of significance). (Total N = 162^ 
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Pilot B: Self-identified environmentally literate students 
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Responsibility 

(scale 0-3) 


Societal 

Responsibility 

(scale 0-3) 


Cognitive 

Questions 

(scale 0-4) 


0 (RP) 
N=116 


1.98 


1.82 


1.82 


2.01 


2.12 


1 (EL) 
N=46 


2.17 


1.99 


2.04 


2.08 


2.59 


level of 
significance 
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Pilot B: Teacher identified environmentally literate students 



SCALE 


Sensitivity/ 

Values 

(scale 0-3) 


Locus of 
Control 

(scale 0-3) 


Personal 

Responsibility 

(scale 0-3) 


Societal 

Responsibility 

(scale 0-3) 


Cognitive 

Questions 

(scale 0-4) 


0 (RP) 
N=38 


2.02 


1.85 


1.89 


2.02 


2.15 


1 (EL) 
N=124 


2.08 


1.94 


1.88 


2.05 


2.58 


level of 
significance 


.438 


.209 


.956 


.709 





Pilot B: Double identified environmentally literate students 



SCALE 


Sensitivity/ 

Values 

(scale 0-3) 


Locus of 
Control 

(scale 0-3) 


Personal 

Responsibility 

(scale 0-3) 


Societal 

Responsibility 

(scale 0-3) 


Cognitive 

Questions 

(scale 0-4) 


0 (RP) 
N=143 


2.02 


1.86 


1.88 


2.03 


2.26 


1 (EL) 
N=19 


2.13 


1.98 


1.97 


2.05 


2.80 


level of 
significance 


.260 


.192 


.503 


.860 
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groups and the rest of piloting population (RP) (shaded numbers are significant using p < 
.05 as level of significance). (Total N = 142) 
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Pilot C: Self-identified environmentally literate students 



SCALE 


Sensitivity/ 

Values 

(scale 0-3) 


Locus of 
Control 

(scale 0-3) 


Personal 

Responsibility 

(scale 0-3) 


Societal 

Responsibility 

(scale 0-3) 


Cognitive 
Questions 
(scale 0-4) 


0 (RP) 
N=109 


1.98 


1.70 


1.72 


1.78 


1.56 


1 (EL) 
N=33 


2.17 


1.80 


1.90 


1.86 


1.86 


level of 
significance 


.114 


.430 


.171 


.461 


.088 



Pilot C: Teacher identified environmentally literate students 



SCALE 


Sensitivity/ 

Values 

(scale 0-3) 


Locus of 
Control 

(scale 0-3) 


Personal 

Responsibility 

(scale 0-3) 


Societal 

Responsibility 

(scale 0-3) 


Cognitive 

Questions 

(scale 0-4) 


0 (RP) 
N=123 


2.03 


1.72 


1.75 


1.79 


1.56 


1 (EL) 
N=19 


2.01 


1.76 


1.84 


1.86 


2.01 


level of 
significance 


.887 


.766 


.603 


.564 


.068 



Pilot C: Double identified environmentally literate students 



SCALE 


Sensitivity/ 

Values 

(scale 0-3) 


Locus of 
Control 

(scale 0-3) 


Personal 

Responsibility 

(scale 0-3) 


Societal 

Responsibility 

(scale 0-3) 


Cognitive 
Questions 
(scale 0-4) 


0 (RP) 
N=137 


2.02 


1.70 


1.75 


1.80 


1.61 


1 (EL) 
N=5 


1.98 


2.27 


1.92 


1.79 


2.13 


level of 
significance 


.865 


§040 • j 


.664 


.932 


.329 



December 1995 Pilot: Comparisons of Means between “environmentally literate” (EL) 
groups and rest of piloting population (RP) (shaded numbers are significant using p < .05 
as level of significance). (Total N = 21 1) 



December Pilot: Self-identified environmentally literate students 



SCALE 


Attitudes/ 

Values 

(scale 0-3) 


Locus of 
control 

(scale 0-3) 


Personal 

Responsibility 

(scale 0-3) 


Societal 

Responsibility 

(scale 0-3) 


Cognitive 

Items 

(scale 0-1) 


0 (RP) 
N=168 


1.85 


1.73 


1.69 


1.74 


.302 


1 (EL) 
N-43 


2.06 


1.93 


1.89 


1.99 


.374 


level of 
significance 
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December Pilot: Teacher identified environmentally literate students 



SCALE 


Attitudes/ 

Values 

(scale 0-3) 


Locus of 
control 

(scale 0-3) 


Personal 

Responsibility 

(scale 0-3) 


Societal 

Responsibility 

(scale 0-3) 


Cognitive 

Items 

(scale 0-1) 


0 (RP) 
N=147 


1.89 


1.73 


1.68 


1.75 


.298 


1 (EL) 
N=64 


1.90 


1.86 


1.83‘ 


1.89 


.360 


level of 
significance 


.820 


.064 


.064 


,.049 1 
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December Pilot: Double identified environmentally literate students 



SCALE 


Attitudes/ 

Values 

(scale 0-3) 


Locus of 
control 

(scale 0-3) 


Personal 

Responsibility 

(scale 0-3) 


Societal 

Responsibility 

(scale 0-3) 


Cognitive 

Items 

(scale 0-1) 


0 (RP) 
N=192 


1.87 


1.75 


1.69 


1.76 


.304 


1 (EL) 
N=19 


2.10 


2.01 


2.10 


2.13 


.453 


level of 
significance 
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Appendix I 



Formative Evaluation Instrument 
Used in Evaluating 
Windows on the Wild Activities 



To: 



From: Judy Braus 

Director of Environmental Education 
World Wildlife Fund 

Date: March, 1996 

World Wildlife Fund (WWF) is currently developing a new environmental 
education program called “Windows on the Wild". The overall goal for 
"Windows" is to increase environmental literacy using biodiversity as the 
organizing theme. Initially, the program is focused on middle school students 
and educators. As part of the program, WWF is producing a series of curriculum 
modules on various biodiversity issues. 

For the past year, WWF has £lso been developing a student survey to find out 
what middle school students know and think about environmental issues related 
to biodiversity. The survey will help determine whether or not the “Windows" 
curriculum helps improve students’ knowledge of and attitudes towards 
biodiversity. 

By the third week of April, we jwill be ready to pilot five introductory biodiversity 
activities using the survey as a pre-test and post-test. (See the description on 
the next page.) In order to run the pilot we are looking for 7th or 8th grade 
science or social studies teachers who are willing to commit seven 
classroom periods to conduct the pre- and post-tests and the five 
activities. The first period would be spent conducting the pre-test. You would 
then have two weeks to conduct the five activities in a way that works best for 
you (every other day; all in one week, etc). The last period would be spent 
conducting the post-test. 

You only need to conduct the survey and activities with one class, but you are 
welcome to do so with as many classes as you’d like. You can choose the time 
period that is best for you between the third week of April and the end of your 
school year. 

If you participate, it is important that the pilot happens within a span of 12 
classroom days and that no; more than one period is spent on each activity. 
It is also necessary that your classes be “average" - not advanced or special 
groups. Copies of the activities will be sent to you by mid-April so that you can 
prepare your curriculum accordingly. We will then send you all of the supplies 
that you will need for conducting the pre- and post-tests. 
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We realize the constant demands placed on teachers and that this is a big 
commitment, espe My this late in the school year. However, we also feel that 
you and your stud will enjOy using the materials. The results of the survey 
will also help provs; mportant information that can help guide future education 
programs. In return Tor vour help. WWF will provide a full set of Window s. 
materials. (This includes a classroom set of biodive rsity magazines with an 
educator's guide and curriculum modules when they a re produced next yearj 
We will also provide you with a $100 honorarium to be u sed for classroom 
supplies. 



If you or any other teachers in 



it yuu ui any umei reawiao ..lyour school are interested in participating in the 
“Windows on the Wild” curriculum pilot, please contact AnneMarie Fleming as 
soon as possible at: Wisconsin Center for Environmental Education, 403 LRC - 
UWSP, Stevens Point, Wl 54481; (715) 346-4950; fax: (715) 346-3025. 



Thank you very much for your time and consideration in this effort. We hope 
you will join us! 



The activities that will be sent to you are from the “Windows on the Wild" module 
called Biodiversity Basics. The activities are: 

What’e Your Biodiversity IQ?: A lighthearted quiz designed to introduce 
students to biodiversity issues This will be followed by reading and discussing 
an interview with E.O. Wilson of Harvard University. 

The Spice of Life: This activity gets students to explore their personal beliefs 
regarding biodiversity. Activity includes designing and creating ads for teaching 
others about biodiversity. 

Panthers and Hippos...Oh My!: This activity uses the case of the Florida 
panther to investigate the major causes of biodiversity loss and how to slow the 
loss. 

Secret Services: Through a charade-like game, students learn about some of 
the ecosystem services biodiversity provides for our world. 

Future Worlds: Students will look at a list of 15 possible pieces of their future 
world, then fit them into a pyramid to reflect their priorities for the future. 
Afterward, they’ll investigate ways people are working to make those possibilities 
turn into realities. 




Thank you for participating in the “Windows on the Wild” pilot 1 There are a few guidelines that we want 
to provide you with to assure that the pilot is conducted consistently with all participating teachers. 

1 We ask that you conduct the five activities within a two-week span However, please do not Spend 

more than one day per activity. (In other words, you may want to skip a day or two between activities or 
conduct them five days in a row ) (Turn this page over for a visual layout ) 

2. A day or two before you start using the activities, give your class the pre-test Your students should 
have a whole class period to take the pre-test If possible, do not let more than two days pass between 
conducting the pre-test and using the activities. 

3. Within two days of finishing the last activity, please give your students the post-test The post-test will 
be the exact same test as the pre-test, :so it is very important that you do not discuss the answers between 
the two. 

4. In summary, your whole pilot should take seven days to complete These seven days should be within a 
span of two weeks and two days - two weeks within which you choose five days to conduct the five 
activities, and a day on either end to conduct the pre- and post-tests ) 



Instructions for Piloting Days: 

Pass out the test booklets, answer sheets, and no. 2 pencils. Make sure your students do not 
write on the testing booklets (because they will be used for the post -test as well, but don’t tell 

them this!) The special code for your class’s pre-test is . Have each student fill this in 

under the “Special Code” section on their answer sheet. You may want to go over the 
instructions and practice questions printed in each booklet. Give your students the whole hour for 
taking the pre- test, if necessary. Please do not discuss the answers with your students at any 
time, until the piloting and thej post-test are complete. 

Take five days to conduct the five activities in the order that is described with your activity 
packet. Please make sure that your students understand that they will not be spending more than 
one day on each activity. (However, if you would like to follow up on any of the activities, 
please just wait to do so until after the students have taken the post -test.) 

Pass out the test booklets, answer sheets, and no. 2 pencils. The special code for your class’s 

post test is: Have each student fill this in on their answer sheet. Once again, make sure 

students have a foil class period for taking the post-test. 

We have included an envelope for you to return the answer sheets from both the pre-test and the post- 
test. (Please make sure the special code section is filled in appropriately for each class - for both 
the pre- and the post-test answer sheets.) We do not need the survey booklets back However, we 
would appreciate hearing your own comments on the survey questions Please feel free to return a 
booklet that has your thoughts written down. 

Have fun! And again, thank you for your participation! 



Day One: 



Days Two- 
Day Six: 



Day Seven: 
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Formative Evaluation Instrument 



"Windows on the Wild” 
Middle School 
Biodiversity Survey 




World Wildlife Fund 

Wisconsin Center for Environmental Education 
April 1996 
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Instructions 



Please mark your answers on the answer sheet. Use a #2 pencil to darken 
the circle you choose. Do not make marks outside the circle. 

This survey has three parts. We will discuss the directions first and then you 
will have the rest of the class period to complete each part of the survey. 

You will also find written directions at the start of each section. 

Part One asks you for some information about yourself. Fill in the circle on 
your answer sheet that most closely matches what you would say. 

Part Two asks what you think about some statements and sets of statements. 
There are no right or wrong answers. An example might be: “I spend too 
much time in school.” 

If you strongly agree with the statement... fill in circle A (strongly agree) 

If you agree with the statement... fill in circle B (agree) 

If you disagree with the statement... fill in circle C (disagree) 

If you strongly disagree with the statement... fill in circle D (strongly 

disagree) 

Part Three asks about what you know. Choose the best answer for each 
question. Notice that there are now five choices: A, B, C, D, and E. 

Here’s a practice question. 



PRACTICE: 



The state of New York is 


of the state of Colorado. 


a) 


south 




b) 


north 




c) 


west 




d) 


east 




e ) 


don’t know 





Don’t worry if you don’t know all the answers. Just do your best. And take 
time to think about each question — there’s no need to rush. Have fun! 
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Part One 

Please answer the following questions on your answer sheet. 



1 . What is your gender? 

a) female 

b) male 



2. Compared to other subjects you study, how do you feel about studying environmental 
topics? 

a) less interested 

b) about the same 

c) more interested 



3. Compared with other students your age, how well do you understand problems related 
to the environment? 

a) above average 

b) average 

c) below average 



To what degree have each of the following contributed to your understanding of the 
environment and environmental problems? 

a great deal some hardly any none 

(a) (b) (c) (d) 

4. school 

5. books, newspapers, or magazines I have read on my own 

6. special programs or activities such as clubs, scouting, or 4H 

7. television programs 

8. family and family activities 

9. friends 



ERIC41 



212 



Part Two 

Fill in the circle on your answer sheet that best matches what you think 
or feel about each statement. 



strongly agree 

(a) 



agree 

(b) 



disagree 

(c) 



strongly disagree 

(d) 



10. A plant or animal can be important just because it is interesting to watch. 

11. If I wanted to, I could help get a law passed to protect plants and animals. 

12. I could convince my classmates to protect plants and animals. 

13. If I saw a person break the law and harm wildlife, it wouldn’t do much good to report 
the person because adults usually don’t listen to people my age. 

14. If I do things like planting trees and putting up nesting boxes, this can help 
animals that are in danger of becoming threatened or extinct. 

1 5. Even if I refuse to buy things that use a lot of resources, my actions won’t matter 
because so many others are still buying too much. 

1 6. Even though there are less than 6,000 tigers left in the wild, I am sure there will still 

be some left in the wild when I’m an adult. 

1 7. Twenty years from now, I think my community will be a better place to live. 

1 8. I believe that endangered species are doomed no matter what we do. 

19. I think it is my responsibility to let people know how the things they buy can affect 
the environment. 

20. The things I do every day show how I protect the environment. 

21 . It is my responsibility to try to get my school to do things like recycle and use less 
paper. 

22. I think that it’s my responsibility to help protect species. 

23. When someone owns land, they should be able to build on it or do whatever they 

want with it. 
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24 . 



We should limit the use of bicycles, boats, and other vehicles if they harm the 
environment. 

25. I believe that my friends need to make changes in their lives to protect the 
environment. 

26. People in the city have more important things to worry about than the loss of plants, 
animals, and ecosystems. 

27. I think we should limit the number of people on the planet to protect the 
environment. 

28. I think that people like scientists and engineers can solve most of the world’s 
environmental problems. 

29. I think it’s impossible to protect the environment and still protect people’s jobs. 

30. Most people I know should change how they live to help solve environmental 
problems. 



For the next three sets of statements, read the heading and mark how 
you think or feel about each statement on your answer sheet. 



strongly agree agree disagree strongly disagree 

(a) (b) (c) (d) 

An important reason for studying about the diversity of plants, animals, and ecosystems 
is because: 

31. I want to know what I can do to help protect them. 

32. there are many interesting jobs relating to these things. 

33. some of the species may be gone by the time I am an adult. 

34. we use many species for food and medicine. 

35. my future, as well as future generations, depend on healthy ecosystems. 
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very important 

(a) 



important 

(b) 



a little important not important at all 



(c) 



(d) 



Consider the following people. How important do you think the protection of 
biodiversity should be for each group? 

36. scientists 

37. people who live in the city 

38. kids my age 

39. people who live in Africa 

40. loggers 

41 . people who live in the country 

42. businessmen 



very important important a little important not important at all 

(a) (b) (c) (d) 

How important do you think it is to protect each of the following kinds of plants and 
animals? 

43. hummingbirds 

44. frogs 

45. worms 

46. vultures 

47. fungi 

48. bats 
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Part Three 

For each of the following, please choose the answer that you believe most 
correctly answers the question. Mark the answer on your answer sheet. 
*Note that there are now five choices instead of four. 



49. Biodiversity is the diversity of life on Earth . To learn more about biodiversity, 
scientists study these levels of diversity: 



a) species, ecosystems 

b) ecosystems, genetics, endangered species 

c) ecosystems, wildlife 

d) ecosystems, genetics, species 

e) don’t know 

50. Grevy’s zebra is an endangered species in Africa. The stripes on one Grevy’s 
zebra can look very different from the stripes of another Grevy’s zebra. This is 
most likely a result of: 

a) genetic diversity. 

b) ecosystem diversity. 

c) species diversity. 

d) a and c 

e) don’t know 

5 1 . Scientists have identified approximately 1 .5 million species living on Earth. Most 
scientists feel that this number is probably: 

a) a little more than the total number of species that exist. 

b) much too high, and many species have been incorrectly identified. 

c) only a portion of the total that exist. 

d) about half the number of living species. 

e) don’t know 

52. An interacting community of living things and their environment is called a(n): 



O 
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a) 

b) 

c) 

d) 

e) 



habitat, 
food chain, 
population, 
ecosystem, 
don’t know 
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53 . 



Which of the following graphs represents the typical trend of most populations 
over time? 



increases 




time 



« 

3 

Cl 

O 

Cl 





don’t 



54. Which of the following is true about extinction? 



a) It’s not a natural process because the last big species to become extinct 
were the dinosaurs. 

b) It’s a natural process, but the rate of extinction is increasing because of 
people’s actions. 

c) It’s not a natural process because people are the only species that can 
cause other species to become extinct. 

d) It’s a natural process, but the rate of extinction is decreasing because 
people are protecting endangered species. 

e) don’t know 



55. There are five major reasons for biodiversity loss. Which list below best 
describes these? 



a) introduced species, pollution, overpopulation, predators, hunting 

b) habitat loss, introduced species, pollution, overpopulation, 
overconsumption 

c) overfishing, pollution, overpopulation, infectious diseases, habitat loss 

d) predators, introduced species, overconsumption, infectious diseases, 
hunting 

e) don’t know 

56. As the number of humans on the planet increases, plant and animal species worldwide 
will probably: 




a) 

b) 

c) 

d) 

e) 



be more likely to reproduce, 
increase in diversity. 

have a better chance of surviving, because there are more people to help save 
them. 

be more seriously threatened. 



don’t know 
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57. In a sealed, healthy aquarium, the oxygen is produced by: 

a) water plants. 

b) fish. 

c) snails. 

d) water. 

e) don’t know 

58. If all bacteria were suddenly removed from the Earth: 

a) animals would have no difficulty in digesting food. 

b) human diseases would disappear. 

c) we would soon be knee deep in garbage and dead organic matter. 

.d) ecosystems would still work normally. 

e) don’t know 

59. Some scientists are concerned that some of our major food crops may be wiped 

out by an insect or a fungus. The best way to make sure that this does not happen 
is to increase among plants. 

a) genetic diversity 

b) interdependence 

c) ecosystem diversity 

d) interactions 

e) don’t know 

60. This diagram best describes a(n): 




a) food chain. 

b) ecosystem. 

c) species webscape. 

d) food web. 

e) don’t know 
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Which of the following is true? 



a) All animals can adapt to changing conditions faster than plants. 

b) Smaller organisms take longer to adapt than larger organisms. 

c) Species either adapt over time or go extinct as a result of change. 

d) Adaptations usually only occur as a result of hurricanes, floods, and other 
disasters. 

e) don’t know 

Scientists are concerned that the world’s frog populations are decreasing. Which 
of the following is not a reason for their concern? 

a) The decrease may mean that the habitat of other species is in danger. 

b) The decrease may mean that oxygen supplies on Earth are decreasing. 

c) The decrease may mean that air or water sources are polluted. 

d) Since frogs are part of many food webs, the decrease may harm other 
species. 

e) don’t know 

Scientists think that more species are becoming extinct today than in the past 
because: 

a) species are not as strong as they used to be. 

b) there are too many species in the world. 

c) habitat changes are happening too fast for species to adapt. 

d) all of the above 

e) don’t know 

If you wanted to preserve the biodiversity of a particular region, what would be 
the most effective approach to protect the region and its inhabitants? 

a) protect the endangered species 

b) protect the most abundant plants 

c) protect the predators 

d) protect the ecosystem 

e) don’t know 

Among the following, which group of living things has the largest number of 
identified species? 

a) insects 

b) plants 

c) mammals 

d) birds & 1 

e) don’t know 



66. All of the following trends (I-IV) affect biodiversity. Which combination of two 
affect biodiversity the most? 

I. Increasing number of people living in urban areas. 

II. Increasing natural resource consumption by people. 

III. Increasing human population. 

IV. Increasing number of toxic waste dumps being deemed up. 

a) I and III 

b) I and IV 

c) I and II 

d) II and III 

e) don’t know 

67. If giraffes were released into the wild in the state of Texas, they would be called 
a(n): 

a) native species. 

b) introduced species. 

c) endangered species. 

d) threatened species. 

e) don’t know 

68. Which of the following is mil true about the human population? 

a) It is declining in the United States and Canada. 

b) It is expected to double within your lifetime. 

c) Its increase has led to the loss of habitat around the world. 

d) The greatest rate of population growth is occurring in some developing 
areas of South America and Africa. 

e) don’t know 

69. If a shopping mall is built in a wetland area, the most immediate threat to the 
plants and animals that live there is: 

a) an increase in the number of roadkills (animals killed by cars). 

b) the loss of habitat. 

c) air pollution from the increased traffic. 

d) an increase in the number of people in the area. 

e) don’t know 
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When a farmer uses a strong pesticide to kill insects destroying his/her crop, which 

of the following is true? 

a) This has no short term effect, but has a significant long term effect. 

b) This has immediate effects, but no long term effects. 

c) This has both short term and long term effects. 

d) This has neither short term nor long term effects. 

e) don’t know 

When working to help resolve an issue in your community, you would first: 

a) learn more about the issue. 

b) interview city/town council about their views. 

c) write letters to people about how you felt on the issue. 

d) survey citizens about their ideas. 

e) don’t know 

What will probably happen if it becomes fashionable to wear necklaces made with 

owl feathers for good luck? 

a) The number of wild owls will decrease and the price of wild owl feathers 
will increase. 

b) The number of wild owls will decrease and the price of wild owl feathers 
will stay about the same. 

c) The number of wild owls and the price of wild owl feathers will stay about 
the same. 

d) The number of wild owls will increase and the price of wild owl feathers 
will stay about the same. 

e) don’t know 

Which of the following is true? 

a) People in India and China use more resources per person than people in 
most other countries. 

b) As a country’s population increases, people always use less resources 
because they leam to use them wisely. 

c) People in Europe and Japan use about the same amount of resources per 
person as Americans do. 

d) North Americans use more resources per person than people in most 
other countries. 

e) don’t know 



74. Many people feel that by living in a sustainable way, we can help slow the loss of 
biodiversity. This means people should: 

a) use natural resources in ways that protect them for the future. 

b) never use animal products. 

c) use technology to create more jobs. 

d) make cities smaller so more people will live in the country. 

e) don’t know 

75 . Which of the following is most likely to help protect endangered species? 

a) outlaw the sale of endangered species or products made from them (skins, 

furs, ivory, etc.). 

b) protect the habitat where they live. 

c) create zoos for key species. 

d) use farming methods that do not damage habitat 

e) don’t know 

76. An aquatic ecosystem is contaminated by a chemical which tends to remain stored in 
body fat. The highest concentration of this chemical would probably be found in 
which group of organisms in the ecosystem? 

a) plant life 

b) minnows 

c) fish that eat insects and plants 

d) birds that eat fish 

e) don’t know 

77. Some people like to have tropical birds as pets. The main reason this could cause 
a species to become endangered is that: 

a) the birds are often mistreated in people’s homes. 

b) the demand for them could reduce wild populations. 

c) they escape from people’s homes, and can die in the unfamiliar habitat. 

d) their natural predators are increasing and taking over the birds’ habitat. 

e) don’t know 

78. The U.S. law that directly relates to protecting biodiversity is called: 

a) The Migratory Waterfowl Act 

b) The Superfund Act. 

c) The Endangered Species Act.. 

d) The Wildlife Forever Act. 

e) don’t know 

222 

ERIC 



151 



79. What is the most helpful way that your shopping habits can help preserve 
biodiversity? 

a) Only buy items that can be recycled. 

b) Buy fewer things. 

c) Avoid buying products with extra packaging. 

d) Make sure that the products you buy did not involve animal testing. 

e) don’t know 

80. Which of the following is the hfisl example of sustainable use of natural resources 

a) riding your bike instead of driving 

b) using natural gas instead of oil to heat your home 

c) using products that don’t involve animal testing 

d) using paper bags instead of plastic bags 

e) don’t know 



Congratulations! You have reached the end of the survey! 



Formative Evaluation Instrument 
Relationship of Items to the Evaluation Outline 


EVALUATION OUTLINE 


Item numbers 


I. COGNITIVE OUTCOMES 




A. Knowledge Of Ecological Principles And 
Processes Related To Biodiversity 




1. Three Levels of Biodiversity 


49 


a. Genetic Diversity 


50, 59 


b. Species Diversity 


51,65 


c. Ecosystem Diversity 


52,64 


2. Ecological Factors Affecting 
Biodiversity 




a. Ecosystem change 


53 


b. Evolution and extinction 


54 


3. The Ecological Value of Biodiversity 




a. Ecosystem, structure, function, 
and interdependence 


57-58, 60, 62 


b. Adaptation and resilience 


61 


B. Knowledge of Problems and Issues Related to 
Biodiversity 




1. Political, Economic, and Social Issues 
Affecting Biodiversity 


55, 66 


a. Habitat Destruction 


63, 69 


b. Introduction of Species 


67 


c. Population Growth 


68, 56 


d. Pollution 


70, 76 


e. Overconsumption 


72, 73, 77 


2. The Value of Biodiversity to Humans 


* 


a. Food/Water/Shelter/Oxygen 




b. Medicine 




c. Aesthetics/Pleasure/Recreation 




3. Science and Technology 




a. Ways it helps biodiversity 




b. Ways it decreases biodiversity 




C. Knowledge of Biodiversity Issue Investigation 
and Action Strategies 




1. Knowledge of strategies used to investigate 
biodiversity problems and issues. 


71 


2. Knowledge of appropriate action 

strategies for the prevention or resolution 
of biodiversity problems and issues. 


74-75, 78-80 « 
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II. AFFECTIVE OUTCOMES 




A. Sensitivity Towards and Positive Values for the 




Prevention and Remediation of Biodiversity 




Problems and Issues 




1. Sensitivity 


10 


2. Values 


31-48 


B. Beliefs about Personal and Societal Efficacy 




Relating to Biodiversity (Predictors of Behavior) 




1. Locus of Control 


11 


a. Political Action 




b. Persuasion 


12 


c. Ecomanagement 


14 


d. Consumerism 


15 


e. Legal Action 


13 


2. Hopefulness/Hopelessness 


16-18 


3. Assumptions of Personal Responsibility 


19-22 


4. Societal Responsibility 


23-30 
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Appendix J 



Formative Evaluation 
Item Results 



Formative Evaluation Item Results 




Note: In some cases percentages do not add to 100 because of missing or erroneous data. 



1 . What is your gender? (N= 1 74) 







%Pre 


% Post 






(N=l 74) 


(N=l 74) 


a) 


female 


53 


53 


b) 


male 


47 


47 


2. 


Compared to other 


subjects you 


study, how do you feel about studying environmental topics? 






%Pre 


% Post 






(N=l 73) 


(N-174) 


a) 


less interested 


21 


21 


b) 


about the same 


54 


53 


c) 


more interested 


25 


26 


3. 


Compared with other students your age, how well do you understand problems related to the 




environment? 


% Pre 


%Post 






(N=l 74) 


(N=l 74) 


a) 


above average 


27 


28 


b) 


average 


67 


66 


c) 


below average 


5 


6 



To what degree have each of the following contributed to your understanding of the environment and 
environmental problems? 



4. school 


a great 

deal 

(a) 


some 

(b) 


hardly any 
(c) 


none 

(d) 


% Pre (N=174) 


29 


52 


16 


3 


% Post (N-174) 


32 


56 


19 


3 


5. books, newspapers, or 


a great 


some 


hardly any 


none 


magazines I have read on 
my own 


deal 

(a) 


(b) 


(c) 


(d) 


% Pre (N=l 74) 


29 


44 


20 


5 


% Post (N=l 74) 


21 


47 


24 


7 



6. special programs or 


a great 


activities such as clubs, 


deal 


scouting, or 4H 


(a) 


% Pre (N-174) 


18 


% Post (N=l 74) 


17 


7. television programs 


a great 
deal 




(a) 


% Pre (N-174) 


39 


% Post (N=173) 


32 


8. family and family 


a great 


activities 


deal 




(a) 


% Pre (N=174) 


18 


% Post (N=173) 


14 


9. friends 


a great 
deal 




(a) 


% Pre (N=174) 


15 


% Post (N= 174) 


10 



some 


hardly any 


none 


(b) 


(c) 


(d) 


31 


24 


24 


32 


24 


27 


some 


hardly any 


none 


(b) 


(c) 


(d) 


34 


20 


7 


38 


21 


9 


some 


hardly any 


none 


(b) 


(c) 


(d) 


26 


29 


26 


33 


27 


25 


some 


hardly any 


none 


(b) 


(c) 


(d) 


14 


25 


44 


18 


28 


43 





Part Two 










Fill in the circle on your answer sheet that best matches what you think or fee! about each 


statement. 










strongly agree 


agree 




disagree 


strongly disagree 


(a) 


(b) 




(c) 


(d) 


10. A plant or 


animal can be important just because it is interesting to watch. 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


%Pre(N=174) 


16 


33 


35 


16 


% Post (14=174) 


20 


37 


28 


14 


11. If I wanted to, I could help 


get a law passed to protect plants and animals. 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (14=174) 


22 


44 


25 


9 


% Post (14=174) 


11 


57 


22 


9 


1 2. I could convince my classmates to protect plants and animals. 






strongly agree 


agree 


disagree 


strongly 




(a) 


(b) 


(c) 


disagree 

(d) 


% Pre (N=174) 


9 


43 


36 


12 


% Post (14=173) 


9 


38 


42 


10 


13. If I saw a person break the law and harm wildlife, it wouldn’t 


do much good to report the person 


because adults usually don’t listen to people my age. 






strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (14=174) 


19 


23 


25 


32 


% Post (N=174) 


15 


20 


39 


26 



14. If I do things like planting trees and putting up nesting boxes, this can help animals that are in 
danger of becoming threatened or extinct. 



% Pre (N=174) 
% Post (N=174) 



strongly agree 


agree 


disagree 


strongly disagree 


(a) 


(b) 


(c) 


(d) 


37 


49 


12 


2 


34 


54 


10 


2 
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1 5. Even if I refuse to buy things that use a lot of resources, my actions won’t matter because so 
many others are still buying too much. 





strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=l 74) 


11 


36 


33 


20 


% Post (N=173) 


15 


32 


33 


20 


1 6. Even though there are less than 6,000 tigers left in the wild, I am sure there will stil 


in the wild when I’m an adult. 








strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=172) 


11 


30 


40 


19 


% Post (N= 173) 


8 


33 


39 


19 


1 7. Twenty years from now, I 


think my community will be a better place to live. 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=172) 


8 


25 


41 


26 


% Post (N= 173) 


8 


28 


39 


25 


1 8. I believe 


that endangered species are doomed no matter what we do. 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=173) 


5 


14 


43 


38 


% Post (N= 172) 


3 


19 


35 


41 


19. I think it 


is my responsibility to let 


people know how the things they buy can affect 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=174) 


15 


39 


33 


13 


% Post (N=173) 


10 


43 


40 


7 


20. The things I do every day 


show how I protect the environment. 






strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=l 74) 


9 


41 


39 


10 


% Post (N= 172) 


17 


43 


30 


9 


21. It is my i 


responsibility to try to get 


my school to do things like recycle and use less | 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=l 74) 


9 


36 


40 


14 


% Post (N= 173) 


11 


37 


42 


10 
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22 . 



I think that it’s my responsibility to help protect species. 





strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=l 74) 


14 


44 


34 


8 


% Post (N=l 74) 


14 


43 


32 


11 


23. When someone owns land, 


they should be able to build on it or do whatever they want with it. 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=l 74) 


22 


34 


25 


19 


% Post (N= 174) 


22 


34 


31 


13 


24. We should 


limit the use of bicycles, boats, and other vehicles 


if they harm the environment. 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=l 73) 


17 


32 


37 


14 


% Post (N=l 74) 


17 


38 


36 


9 


25. I believe that my friends need to make changes in their lives to protect the environment. 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=l 74) 


12 


43 


33 


11 


% Post (N=174) 


16 


42 


32 


10 


26. People in the city have more important things to worry about than the loss of plants, animals. 


ecosystems. 










strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=l 73) 


8 


18 


34 


40 


% Post (N=l 74) 


10 


23 


28 


39 


27. I think we 


should limit the number of people 


on the planet to protect the environment. 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=l 74) 


11 


19 


28 


41 


% Post (N=l 73) 


12 


25 


29 


34 
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28. 



I think that people like scientists and engineers can solve most of the world s environmental 
problems. 





strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


%Pre(N=174) 


8 


30 


46 


16 


% Post (N=174) 


10 


35 


39 


16 


29. I think it’ 


s impossible to protect the environment and still protect people’s jobs. 




strongly agree 


agree 


disagree 


strongly disagree 




(a) 


(b) 


(c) 


(d) 


% Pre (N=173) 


8 


23 


39 


29 


% Post (N=172) 


10 


23 


42 


25 



30. Most people I know should change how they live to help solve environmental problems. 



Pre(N=173) 



strongly agree 


agree 


disagree 


strongly disagree 


(a) 


(b) 


(c) 


(d) 


14 


35 


40 


10 


14 


41 


33 


13 



For the next three sets of statements, read the heading and mark how you think or feel about each 
statement on your answer sheet 
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An important reason for studying about the diversity of plants, animals, and ecosystems is because: 
31. I want to know what I can do to help protect them. 

strongly disagree 

(d) 

3 
2 



strongly 

disagree 

(d) 

5 

3 





strongly agree 


agree 


disagree 




(a) 


(b) 


(c) 


% Pre (N=l 74) 


30 


48 


18 


% Post (N=174) 


33 


51 


14 


32. there are 


many interesting jobs relating to these things. 




strongly agree 


agree 


disagree 




(a) 


(b) 


(c) 


% Pre (N=174) 


19 


57 


20 


% Post (N=l 74) 


25 


55 


17 


33. some of the species may be 


gone by the time I am an adult. 




strongly agree 


agree 


disagree 




(a) 


(b) 


(c) 


% Pre (N=l 74) 


40 


47 


9 


% Post (N=l 73) 


48 


42 


8 



strongly disagree 

(d) 

5 

2 
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34. we use many species for food and medicine. 



% Pre (74=1 74) 
% Post (N=174) 


strongly agree 
(a) 

28 

35 


agree 

(b) 

51 

51 


disagree 

(c) 

17 

9 


strongly disagree 

(d) 

5 

6 


35. my future, 


as well as future 


generations, depend on healthy ecosystems. 


% Pre (74=1 73) 
% Post (74=174) 


strongly agree 
(a) 

43 

50 


agree 

(b) 

45 

41 


disagree 

(c) 

9 

7 


strongly disagree 

(d) 

3 

2 



Consider the following people. How important do you think the protection of biodiversity should 
be for each group? 



36. 



scientists 



very important 


important 


a little 


not important at all 


(a) 


(b) 


important 

(c) 


(d) 


% Pre (N=173) 59 


32 


7 


2 


% Post (74=174) 64 


30 


3 


2 


37. people who live in the city 


very important 


important 


a little important 


not important at all 


(a) 


(b) 


(c) 


(d) 


% Pre (74=173) 23 


40 


31 


6 


% Post (74=174) 32 


36 


28 


5 


38. kids my age 


very important 


important 


a little important 


not important at all 


(a) 


(b) 


(c) 


(d) 


% Pre (74=172) 40 


35 


17 


7 


% Post (74=174) 36 


37 


19 


7 


39. people who live in Africa 


very important 


important 


a little important 


not important at all 


(a) 


(b) 


(c) 


(d) 


% Pre (74=172) 30 


43 


17 


8 


% Post (74=173) 36 


45 


16 


3 
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40. loggers 



very important 


important 


a little important 


not important at all 


(a) 


(b) 


(c) 


(d) 


% Pre (N=171) 27 


25 


25 


22 


% Post (N=174) 30 


36 


22 


10 


4 1 . people who live in the country 

very important important 


a little important 


not important at all 


(a) 


(b) 


(c) 


(d) 


% Pre (N=173) 29 


40 


18 


11 


% Post (N=l 74) 39 


39 


16 


6 


42. businessmen 


very important 


important 


a little important 


not important at all 


(a) 


(b) 


(c) 


(d) 


% Pre (N=l 73) 20 


34 


21 


24 


% Post (N=174) 28 


36 


21 


15 


How important do you think it is to protect each of the following kinds of plants and animals? 


43. hummingbirds 


very important 


important 


a little important 


not important at all 


(a) 


(b) 


(c) 


(d) 


% Pre (N=172) 46 


30 


19 


4 


% Post (N=174) 45 


37 


14 


4 


44. frogs 


very important 


important 


a little important 


not important at all 


(a) 


(b) 


(c) 


(d) 


% Pre (N=173) 47 


29 


17 


5 


% Post (14=174) 47 


40 


11 


3 


45. worms 


very important 


important 


a little 


not important 


(a) 


(b) 


important 


at all 


% Pre (N=173) 47 


26 


(c) 

16 


(d) 

10 


% Post (14=173) 51 


32 


12 


5 
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46. vultures 



%Pre(N=173) 
% Post (N=174) 


very important 

(a) 

37 

41 


important 

(b) 

30 

35 


a little important 

(c) 

21 

18 


not important at all 

(d) 

12 

6 


47. fungi 










%Pre(N=172) 
% Post (N=l 74) 


very important 

(a) 

33 

48 


important 

(b) 

28 

33 


a little important 

(c) 

22 

11 


not important at all 

(d) 

16 

9 


48. bats 










% Pre (N=173) 
% Post (N=l 74) 


very important 
(a) 

38 

43 


important 

(b) 

30 

37 


a little important 

(c) 

18 

13 


not important at all 

(d) 

13 

7 
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Part Three 

For each of the following, please choose the answer that you believe most correctly answers the 
question. Mark the answer on your answer sheet. 

*Note that there are now five choices instead of four. 



49. 



a) 

b) 

c) 

d) 

e) 

50. 



a) 

b) 

c) 

d) 

e) 

51. 



a) 

b) 

c) 

d) 

e) 

52. 



a) 

b) 

c) 

d) 

e) 



Biodiversity is the diversity of life on Earth . 
these levels of diversity: 

species, ecosystems 

ecosystems, genetics, endangered species 
ecosystems, wildlife 
ecosystems, genetics, species 
don’t know 



To learn more about biodiversity, scientists study 



%Pre 


% Post 


(N=172) 


(N=J73) 


8 


17 


16 


19 


19 


15 


19 


29 


38 


20 



Grevy’s zebra is an endangered species in Africa. The stripes on one Grevy’s zebra can look 
very different from the stripes of another Grevy’s zebra. This is most likely a result of: 





%Pre 


% Post 




(N=171) 


(N=172) 


genetic diversity. 


26 


35 


ecosystem diversity. 


6 


8 


species diversity. 


8 


12 


a and c 


37 


32 


don’t know 


23 


13 


Scientists have identified approximately 1.5 million species living on 


Earth. Most 




scientists feel that this number is probably: 




%Pre 


% Post 




(N=173) 


(N=173) 


a little more than the total number of species that exist. 


12 


13 


much too high, and many species have been incorrectly identified. 


8 


3 


only a portion of the total that exist. 


35 


48 


about half the number of living species. 


14 


17 


don’t know 


30 


19 


An interacting community of living things and their environment is called a(n): 






%Pre 


% Post 




(N=173) 


(N=173) 


habitat. 


40 


31 


food chain. 


8 


9 


population. 


7 


5 


ecosystem. 


don’t know 


y 


y 
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53 Which of the following graphs represents the typical trend of most populations over time? 

%Pre %Post 

(N=173) (N=l 73) 

37 41 




e 

o 



a. 

o 

a. 




time 

stays the same 




Q. 



.5 

c) % 

time 



goes up and down 




decreases 
e) don’t know 



39 35 



10 10 



9 9 



Which of the following is lni£ about extinction? 

It’s not a natural process because the last big species to become extinct 


% Pre 
(N=171) 
6 


%Post 

(N=173) 

8 


were the dinosaurs. 

It’s a natural process, but the rate of extinction is increasing 


47 


60 


because of people’s actions. 

It’s not a natural process because people are the only species that can 


19 


16 


cause other species to become extinct. 

It’s a natural process, but the rate of extinction is decreasing because 


13 


4 


people are protecting endangered species, 
don’t know 


15 


12 
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55. 


There are five major reasons for biodiversity loss. Which list below best describes thes 


p ** 


a) 


introduced species, pollution, overpopulation, predators, hunting 


% Pre 
(N=l 73) 
8 


Post 

(N=173) 

17 


b) 


habitat loss, introduced species, pollution, overpopulation, 


29 


50 


c) 


overconsumption 

overfishing, pollution, overpopulation, infectious diseases, habitat loss 


18 


13 


d) 


predators, introduced species, overconsumption, infectious diseases. 


13 


8 


e) 


hunting 
don’t know 


32 


13 


56. 


As the number of humans on the planet increases, plant and animal species worldwide will 


probably: 

a) be more likely to reproduce. 


% Pre 
(N=l 73) 
6 


% Post 
(N=173) 
9 


b) 


increase in diversity. 


6 


8 


c) 


have a better chance of surviving, because there are more people to 


8 


8 


d) 


help save them. 

be more seriously threatened. 


69 


66 


e) 


don’t know 


11 


10 


57. 

a) 


In a sealed, healthy aquarium, the oxygen is produced by: 
water plants. 


% Pre 
(N=l 73) 
48 


% Post 
(N=173) 
52 


b) 


fish. 


10 


10 


c) 


snails. 


9 


5 


d) 


water. 


13 


13 


e) 


don’t know 


21 


20 


58. 

a) 


If all bacteria were suddenly removed from the Earth: 
animals would have no difficulty in digesting food. 


% Pre 

(N=173) 

4 


% Post 
(N=l 73) 
8 


b) 


human diseases would disappear. 


20 


20 


c) 


we would soon be knee deep in garbage and dead organic matter. 


43 


50 


d) 


ecosystems would still work normally. 


7 


5 


e) 


don’t know 


26 


18 
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Some scientists are concerned that some of our major food crops may be wiped out by an insect 
or a fungus. The best way to make sure that this does not happen is to increase among plants. 



genetic diversity 
interdependence 
ecosystem diversity 
interactions 
don’t know 



% Pre 


% Post 


(N=173) 


(N=172) 


15 


24 


8 


10 


15 


17 


7 


8 


55 


40 



This diagram best describes a(n): 



* mountain lions 

deer snakes 

^ ?owls 
mice ^ 

seed-eating 

trees \ birds 

squirrels 

* vegetables & grass 





rabbits 




food chain, 
ecosystem, 
species webscape. 
food web. 
don’t know 



% Pre 


% Post 


(N=173) 


(N=173) 


52 


47 


5 


4 


5 


4 


36 


42 


2 


3 



Which of the following is true? 

% Pre 

(N=169) 

All animals can adapt to changing conditions faster than plants. 7 

Smaller organisms take longer to adapt than larger organisms. 6 

Species either adapt over time or go extinct as a result of change. 56 
Adaptations usually only occur as a result of hurricanes, floods, and 8 
other disasters. 

24 

don’t know 



% Post 
(N-172) 
13 
6 
53 
9 

20 



Scientists are concerned that the world’s frog populations are decreasing. Which of the 
following is nfll a reason for their concern? 

%Pre 

(N=169) 

The decrease may mean that the habitat of other species is in danger. 8 

The decrease may mean that oxygen supplies on Earth are 43 

decreasing. 

The decrease may mean that air or water sources are polluted. 1 2 

Since frogs are part of many food webs, the decrease may harm other 1 5 

species. 

r 99 

don’t know 



% Post 
(N=171) 
11 
40 

10 

16 

24 



Scientists think that more species are becoming extinct today than in the past because: 



species are not as strong as they used to be. 

there are too many species in the world. 

habitat changes are happening too fast for species to adapt. 

all of the above 

don’t know 



% Pre 


% Post 


(N=168) 


(N= 171) 


4 


3 


8 


3 


52 


61 


27 


26 


9 


7 



If you wanted to preserve the biodiversity of a particular region, what would be the mflSi 
effective approach to protect the region and its inhabitants? 



protect the endangered species 
protect the most abundant plants 
protect the predators 
protect the ecosystem 
don’t know 



% Pre 


% Post 


(N=166) 


(N=168) 


14 


21 


7 


5 


5 


6 


49 


52 


24 


16 



Among the following, which group of living things has the largest number of identified species? 



insects 

plants 

mammals 

birds 



% Pre 


% Post 


(N=168) 


(N=169) 


48 


53 


17 


13 


17 


19 


4 


5 



AH of the following trends (MV) affect biodiversity. Which combination of two affect 
biodiversity the most? 



1. Increasing number of people living in urban areas. 



II. Increasing natural resource consumption by people. 

III. Increasing human population. 

IV. Increasing number of toxic waste dumps being cleaned up. 


% Pre 


% Post 




(N=168) 


(N=168) 


I and III 


17 


17 


land IV 


10 


14 


I and II 


14 


19 


II and III 


27 


32 


don’t know 


33 


18 


If giraffes were released into the wild in the state of Texas, they would be called a(n): 






% Pre 


% Post 




(N=168) 


(N=169) 


native species. 


14 


13 


introduced species. 


57 


69 


endangered species. 


7 


7 


threatened species. 


8 


2 


don’t know 


14 


9 



Which of the following is nol true about the human population? 





% Pre 


% Post 




(N=168) 


(N=168) 


It is declining in the United States and Canada. 


38 


45 


It is expected to double within your lifetime. 


14 


13 


Its increase has led to the loss of habitat around the world. 


10 


12 


The greatest rate of population growth is occurring in some developing 
areas of South America and Africa. 


15 


13 


don’t know 


24 





When a farmer uses a strong pesticide to 
following is true? 



kill insects destroying his/her crop, which of the 

% Pre % Post 



This has no short term effect, but has a significant long term effect. 
This has immediate effects, but no long term effects. 

This has both short term and long term effects. 

This has neither short term nor long term effects, 
don’t know 



(N=165) 

11 

14 

44 

2 

29 



(N=166) 

13 

10 

42 

8 

26 



When working to help resolve an issue in your community, you would first: 

% Pre 
(N=163) 

learn more about the issue. 60 

interview city/town council about their views. 10 

write letters to people about how you felt on the issue. 13 

survey citizens about their ideas. ' 

don’t know 10 



% Post 

(N=166) 

64 

9 

7 

7 

13 



What will probably happen if it becomes fashionable to wear necklaces made with owl feathers 



for good luck? 

% Pre 

(N=163) 

The number of wild owls will decrease and the price of wild owl 69 
feathers will increase. 

The number of wild owls will decrease and the price of wild owl 14 

feathers will stay about the same. 

The number of wild owls and the price of wild owl feathers will stay 4 
about the same. 

The number of wild owls will increase and the price of wild owl 4 

feathers will stay about the same. 

don’t know 9 



%Post 

(N=164) 

63 

9 

9 

7 

13 



Which of the following is true? 

% Pre 

(N=163) 

People in India and China use more resources per person than people in 7 
most other countries. 

As a country’s population increases, people always use less resources 8 
because they learn to use them wisely. 

People in Europe and Japan use about the same amount of resources 7 
per person as Americans do. 

North Americans use more resources per person than people in 36 
most other countries. 

don’t know ^ 



% Post 
(N=166) 
10 

11 

16 

34 

30 



74 . 



a) 

b) 

c) 

d) 

e) 



Many people feel that by living in a sustainable way, we can help slow the loss of biodiversity. 
This means people should: 



use natural resources in ways that protect them for the future. 

never use animal products. 

use technology to create more jobs. 

make cities smaller so more people will live in the country. 

don’t know 



% Pre 
(N=162) 
46 
12 
10 
7 

24 



% Post 

(N=166) 

50 

14 

10 

4 

22 



75. Which of the following is most likely to help protect endangered species? 



a) 


outlaw the sale of endangered species or products made from them 


% Pre 

(N= 161) 
25 


% Post 
(N=166) 
18 


b) 


(skins, furs, ivory, etc.). 

protect the habitat where they live. 


47 


49 


c) 


create zoos for key species. 


11 


11 


d) 


use farming methods that do not damage habitat 


9 


8 


e) 


don’t know 


9 


13 


76. 


An aquatic ecosystem is contaminated by a chemical which tends to remain stored in body fat. 


a) 


The highest concentration of this chemical would probably be found in which group of 

organisms in the ecosystem? 

% Pre 
(N=160) 

plant life 14 


% Post 
(N=165) 
15 


b) 


minnows 


11 


8 


c) 


fish that eat insects and plants 


13 


23 


d) 


birds that eat fish 


20 


21 


e) 


don’t know 


42 


33 


77. 


Some people like to have tropical birds as pets. The main reason this could cause a species to 


a) 


become endangered is that: 

the birds are often mistreated in people’s homes. 


% Pre 
(N=1S9) 

16 


% Post 
(N=16S) 
18 


b) 


the demand for them could reduce wild populations. 


36 


41 


c) 


they escape from people’s homes, and can die in the unfamiliar 


19 


12 


d) 


habitat. 

their natural predators are increasing and taking over the birds’ 


13 


12 


e) 


habitat, 
don’t know 


16 


18 
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78. 



a) 

b) 

c) 

d) 

e) 



79. 



a) 

b) 

c) 

d) 

e) 



The U.S. law that directly relates to protecting biodiversity is called: 
The Migratory Waterfowl Act. 


% Pre 
(N=159) 
5 


% Post 
(N=166) 
6 


The Superfund Act. 


7 


12 


The Endangered Species Act. 


35 


31 


The Wildlife Forever Act. 


15 


20 


don’t know 


38 


31 


What i« the most helpful wav that vour shopping habits can help preserve biodiversity? 

%Pre 


% Post 


Only buy items that can be recycled. 


(N=159) 

24 


(N=165) 

21 


Buy fewer things. 


11 


10 


Avoid buying products with extra packaging. 


23 


32 


Make sure that the products you buy did not involve animal testing. 


25 


27 


don’t know 


18 


10 



80. Which of the following is the best example of sustainable use of natural resources? 



a) riding your bike instead of driving 

b) using natural gas instead of oil to heat your home 

c) using products that don’t involve animal testing 

d) using paper bags instead of plastic bags 

e) don’t know 



% Pre 


% Post 


(N=159) 


(N=166) 


50 


41 


12 


19 


11 


11 


10 


14 


18 


15 



Congratulations! You have reached the end of the survey! 
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Appendix K 



Formative Evaluation 
Subscale Results 



o 

ERJC , 



24q 
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Summary of Subscale Mean Scores for Formative Evaluation 
of Windows on the Wild - Spring 1996 



SubScale: 


Whole Group 

pretest mean 
posttest mean 

significance 

(N=174) 


Arlington, VA 
pretest mean 
posttest mean 

s|c jf» 

significance 

(N=81) 


Seattle, WA 

j(c 

pretest mean 

posttest mean 
}|( 

significance 

(N=93) 


Attitudes/Values 


1.98 (pre) 
2.13 (post) 


1.99 (pre) 
2.13 (post) 


1.98 (pre) 
2:13 (post) 


Cognitive 


0.41 (pre) 
0.45 (post) 


0.47 (pre) 
0.47 (post) 
.942 (sig) 


0.36 (pre) 
0.44 (post) 


Efficacy 
(LOC etc.) 


1.62 (pre) 

1.63 (post) 
.843 (sig) 


1.68 (pre) 

1.69 (post) 
.85 (sig) 


1.57 (pre) 

1.58 (post) 
.91 (sig) 



* Note: Mean scores for the attitude/values and efficacy subscales were calculated 
based on a scale of from 0 to 3 where 3 equals the preferred response. 
Mean scores for the cognitive subscale were calculated based on a scale 
of from 0 to 1 where 1 equals the preferred response. 



** Changes in scores from pretest to posttest were considered to be significant if 
the probability level was less than .050. 
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